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ABSTRACT 

This is a report on the fourth year of the Let's Be 
Aaigos bilingual project. The project consists of three components: 
Rodel A provides bilingual/ticultural education to English-dominant 
and Spanish-dominant pupils in prekindorgarten through fourth grade; 
Model B provides bilingual/bicultural education to Spiinish-dominant 
pupils, first through third grade; Arriba provides Spanish-language 
instruction with English taught as a second language, grades three 
through twelve. Part 1 examines program processes and includes: 
general evaluation; curriculum reorganization and e^ralusition; and 
evaluations of Model B by principals of participating schools. Part 2 
studies pupil performance and includes: pupl.l performance evaluation; 
description of standardized testing; and a study of the effect of 
participation in the Arriba program on graduation prevalence. Data 
analyses and samples of materials illustrate the report, and a 
bibliography is appended. fAN) 
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ABSTRACT 



The 1972-1973 LET'S BE AMIGOS Title VII program provided bilingual- 
bicultural education to Knglish-doininant and Spanish-dominant pupils in 
eleven schools. This was its fourth operational year. The program con- 
sisted of three educational components whose aim was to meet the unique needs 
of the Spanish-speaking while fostering bilingual-biculturalism among all 
participants . 

MODEL A provided bilingual'-bicultural education to all pupils, 
English-and Spanish-dominant, enrolled in prekindergarten through Grade 4 
at the Potter-Thomas School. It used team teaching to provide instruction 
in both English and Spanish languages to pupils in all subject areas. 

MODEL B provided bilingual-bicultural education to Spanish- 
dominant children in selected f irst- , second- , and tLiird-grade classes. The 
instructional procedxire was similar to that provided to the Spanish-dominant 
group of MODEL A. It was conducted at Miller and Li.ilow Schools, 

ARRIBA provided instruction in major subject areas in Spanish, and 
instruction in English as a second language. It served pupils in Grades 3-12 
in Ludlow, Waring r and Southwark elementary schools, Penn Treaty and stoddart- 
Fleisher junior high schools, and Edison, Kensington, Franklin, and Penn 
Senior high schools. 

During the 1972-1973 school year there were two lengthy teacher 
strikes. Despite these two disruptions in the education of the children, 
major findings of the current evaluation showed that performance was generally 
better, and at no time worse, than preprogram performance. 

Spanish reading performance of Spanish-dominant children was 
superior tc -hat of preprogram base-line groups in virtually all levels and 
components of the program* in the Model School components, this performance 
was similar to that obtained in Puerto Rico by the test makers. 

English language-arts performance of Spanish-dominant children was 
at the target in third grade and somewhat behind the target level in fourth 
grade (the two only levels in which it was tested) . 

Standardized test performance of English-dominant pupils was at 
least the same as^ and often superior to, preprogram baselines. 

Spanish reading performsmce of the English-dominant groups was 
far superior to that expected. 

In the high schools, the program has been effective in greatly in- 
creasing the n\junber of pupils who graduated school • 

In addition to these findings, process-evaluation studies revealed 
principal's attitudes toward bilingual education, strengths and weaknesses 
of the curriculim development, and ways in which some program objectives 
needed to be modified. 
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StIMMARy OP THE "LET'S BE AMIGOS" PROJECT EVALUATION 



The LET'S BE AMIGOS progrfcim has been in operation for four years. 
AS ia the case with any complex program, over this time span the evalua- 
tions ot the program have changed, as some questions were answered with 
high degrees of confidence in the evaluations of the flrsr years, they 
have been replaced by new questions, appropriate for a more mature program. 
Hie early evaluation results are believed to continue to be a fair rep- 
resentation of program outcomes, and are therefore still relevant. 

r^n„o ^^^^^ provides a review of the major findings in the 

LET S BE AMIGOS progre^m to date. Each study comprising this report is taken 
up in turn, if a study was a replication of previous evaluative research 
in the program, the fact is noted, as are any differences in the outcomes. 
Following this summary, major outcomes of previous evaluations not repli- 
cated are cited. ^ 



Study 1. General Process Evaluation 

In the fourth operational year, the t; .ee components of the 
Bilingual Program were serving 1,834 students— 1,189 in the MCDEL A 
Bilingual School, 170 in the MODEL B Bilingual Scbcxjl program, and 475 in 
ARRIBA programs. Of these students 1.110 were judged to be Spanish-speaking, 
184 were judged to be speakers of both Spanish and English, and 523 were 
judged to be speakers of English. (Data are lacking for the remaining few 
^tTT'lr^^^ English-speaking pupils were virtually all partic.'.pants in 
MODEL A; MODEL B and ARRIBA Students were nearly all Spanish-speaking. 

The MODEL A program operated in the Potted-Thomas School, pre- 
kindergarten tturough fourth grade, with teams of English- and Spanlsh- 
wf^**™? teachers working with the pupils. In the early grades i^istruction 
was predominantly m the mother tongue. As pupils matured, increased con- 
tact with the second language was built into the program, 

TWO schcols—Miller and Ludlow— had first- through third-grade 
Classes which comprised the MODEL B cotr.poner.t. The course of study was 
similar to that of MCffiEL A for Spanish-dofninant pupils. Spanish-speaking 
teachers worked with classes of pupils dominant In the teaser's mother 
tongue. Itinerant second-language specialists worked with the pupils in 
their specialty— English as a second language. 

h4„>, « K schools— two elementary, two junior high, and four senior 

nnn^r^r "?!T ""^^ ""^^^ program. This served primarily Spanish-speaking 
II til lev.?r instruction in, their moLer tongue. 

a« f L f ? ^^^^ ''^''^ ""^"'^ ^P^"^^^ ^ language, English 

Se content ofT'^'' T^"^^" "P^'^'^^' science in Spanish. 

^i^ar to t^f ^^'..'rTr' ''"^^^ ""^"^ ^'^^^ ^^'^ (Where possible) 

similar to the English-language program studied in the Philadelphia schools 
At the elementary and junior high schools pupils served by the program 
all subjects offered for their grade levels. At the high schoo? lllTl 
™ H • could select courses from among those offered by the program. In 

to fi;^L»^r ''^"'^"'^^"■""^"'^ commercial courses in Spanish were adSed 
to the ARRIHA component during the 1971-1972 year and werfcontinued in 
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During 1972-1973 there were two uncontrollable events which 
possibly affected pupil performance and made it atypical; two citywide 
teacher strikes resulted in extensive closing of schools r and the illness 
and death of one of the program supervisors left void in the program 
management which could not be filled completely. 

Principals decided to drop English-speaking pupils from partici- 
pation in the MODEL B program* Study < (See below) describes the principals' 
action in detail. 



Study 2> Reorganization of MODEL A and MODEL B Micro-objective s 

Micro-objeCvives are the individual behavioral bits which the 
Model School components are designed to teach. In -^ach of the preceding 
years r as these components cycled upward through the grades, new and uixp- 
pcsedly more difficult objectives were adopted for the added grade levels. 
By the beginning of the fourth year, it appeared that the micro-objectives 
were not in the optimal order for an orderly instructional program. This 
study shows how expert teachers reordered the micro-objectives into a 
continuous scale. In all subject areas, the agreement among raters was very 
high. Results showed that in two areas — language arts (first and second 
language) and social studies-— the order in which these teachers felt material 
should be mastered was quite different from that appearing in the original 
sequence. This suggested that revision of the curriculum sequence was needed. 



Study 3> Evaluation of Social Studies and Science Materials 

Materials developed for the junior high school social studies and 
science curricula were evaluated through criterion-referent testing of 
seventh-grade pupils wl:o worked with them# Results showed that the materials^ 
as they were taught by the program staff , did not result in adequate per- 
formance. Careful review of the materials and the teaching procedures used 
was suggested. 



Study 4> Principals' Perceptions of MODEL B . 

MODEL B has been the most difficult component of the LET'S BE 
AMIGOS project to implement. This study attempted to gain insight into 
the difficulties by reviewing the component with four principals who have 
or have had the program in their schools. The major finding was that three 
of the principals who have worked with this component generally feel uneasy 
about the instruction in a language other than English^ especially when 
the instruction involves English-speaking pupils and when the instruction 
is more than a temporary measure to meet the needs of children with problems. 

The fourth principal dropped the program when the number of 
Spanish^speaking pupils fell below earlier expectations. This fourth princi- 
pal has maintained some bilingual instruction supported by her own school's 




regular funds to meet the needs of the few S.nanish-speaking pupils on roll. 

Study 5. Kindergarten and Prekindergarten Pupil Performance in MCOEL A 

Both English-dominant and Spanish-dominant kindergarten pupils 
were teisted using thu Philadelphia .diness Teat in the pupils' mother 
tongues. Both pupil gron-s were ^ orming better than the preprogram 
base-line groups. This was a replication of performance found in the first 
and third years of program operation, and was superior to pupil performance 
in the program's second operational year. 

In addition to the Philadelphia Readiness itest, a newer instru- 
ment—the Boehm Test of Basic Concepts—was tried, in the Spanish-dominant 
group, pupils were at the 50th percentile (Low S.E.S. norms). English- 
domxnant pupxls were at the 65th percentile; but variation in the testing 
procedures used might account for the observed differences. 

Within the kindergar+^en group, a special a? 1-day kindergarten 
(consisting mainly of pupils with prekindergarten experience) was held. 
Results with both the Philadelphia Readiness Test and th^ Boehm test showed 
highly superior levels of performance, with Boehm average scores at the 
75th percentile (Spanish-dominant) and the 70th percentile (English-dominant) 

Use of part of the Boehm test in the prekindergarten suggested 
that there was enough variability in scores to make it useful in discrimina- 
ting candidates for all-day kindergarten from those who should be enrolled 
in regular kindergarten. 

Study 6. Standardized Testing of Pupils in Second Through Fourth Grades 

This testing examined performance of program participants on 
norm-referenced instruments which measured reading and (in English) other 
skil].s. Results showed that in all components (except for a small group 
of ARRIBA pupils in fourth grade) Spanish-dominant pupil performance in 
Spanish was about good as that of pupils in rural Puerto Rico (mean scores 
ranged from the 40th to the 65th percentile). This compared with base- 
line performances which ranged from the 5th to the 35th percentile. 

English-dominant pupil performance in English was significantly 
higher than the historical base-lines in the second grade, and about equal 
to that of the base-line groups in the third and fourth grades. 

In the second language, Spanish-dominant pupils performed at 
expected levels in the third grade but were below the anticipated levels in 
the fourth grode. 

Fourth-grade English-dominant pupils' performance in Spanish was 
surprisingly good, with pupils performing like third-grade native Spanish 
speakers. 
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Results shi^ed that^ despite the interruptions due to the strikes, 
Spanish- language performance in the second- through fourth-grade levels was 
better than anticipated and better than observed in previous years • English- 
language performance was about the same as that of pupils in the base line 
despite tihese disruptions. 



Study 1. Standardized Testing of Reading in Junior High ARRIBA 

This study replicated procer'.ures used in the 1971-1972 school 
year to assess Spanish reading performance. The pupils in the seventh and 
eighth grades of the program were substantially above the be ae line, but not 
quite so good as in the 1971-1972 school year, possibly due to the strikes* 
In contrast, pupils in the ninth grade performed better than the relatively 
low level of pupils in the program last year. 



study 8. Effect of ARRIBA Participation on Grac '^tion Rate 



In two previous evaluations, it was found that the dropout rate 
of pupils in the program was reduced during the school year* -This study 
demonstrated that the observed reductions were maintained over the years, 
increasing the number of pupils who gradtiated* The percentage of pupils 
graduating in 1973 was computed for Spanish-dominant pupils who had been in 
the program in tenth grade and those who had not* Among Spanish-dominant 
pupils attending the four high schools served by the program, participants 
were four times as likely to graduate as were pupils not participating. 
Citywide, pupils in the program were nearly twice as likely to graduate as 
were nonpar ticipa ting Spanish-dominant pupils. 



Major Findings in Previous Reports 

previous reports have shown some other facts, not studied daring 

1972-1973: 

1* Pupils mastered arithmetic and writing skills at or above 
levels specified in objetives oa specially designed criterion tests (MODEL A) 

2. Teachers believe tMt pupils show more adaptive classroom 
behaviors when in classes in which their mother tongue is the medium of 
instruction (MODEL A) . 

3. Pupils in the program tend to have more improved grades and 
behavior ratings than control pupils (ARRIBA) . 

4* Parents, teachers, and principals have generally been sup* 
portive of the program and have wished that the children continue to par- 
ticipate in it. 
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Conclus ion 



Overall results show that the LET'S BE AMIGOS project has 
improved performance of most Spanish-speaking participants in most areas 
examined • The project has^ as a minimum^ introduced English-speaking 
children to a second language without apparent harm, and has frequently 
enhanced their performance in some academic areas in English, 
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STUDY 1 



GENERAL PBOCESS EVALUATION 



In the first two •valuation reports prepared for the LET'S BE 
AHI{X}S program, coomsent was made on individual proceap objectives. 
Beginning with the third yearr process evaluation haa focused on specific 
issues which arose during the achool year and required attention. 
This year's evaluation information is again being presented in three 
ways as it vas last year. Data gathered in time for the continuation 
proposali^ a^i^ared in that document (See the LET'S B£ AHIQOS Continua- 
tion Proposal^ 197 -1974) ; data not available for the continuation 
proposal or which needed to be VBpdated at the end of the year appear 
in this study. In addition , questions which were eacaituLned extensively 
^^re presented as separate studies in this report (Studies 2, 3^ and 4). 



Description of the Cooponents 

MODEL A . The JODEL A program continued to operate at the 
Potter-Thosaas School^ where it encon^passed prekindargarten through 
fourth--grada classes, the last of these being new during the fourth 
operational year. 

The MODEL A program plan was to team-teach^ with native 
English-speaking teachers and native Spanish-speaking teachers (nearly 
all of whom had at least working knowledge of both languages) teaching 
pairs of classes. Pupils in each pair of classes met in linguisticetlly 
iBixed or hoiaogeneous groups ^ yf^th most instruction in homogeneous, 
mother-tongue groups in the lower grades end greater amounts of second* 
language contact in both homogeneous and mixed grov^ in the upper grades. 

Diiring the typical achool day, pupils moved between teachers 
in the team, assuring that each child had some experiences in this mother 
tongue and his second language and in ethnically hcmDgeneous and ethni- 
cally diverse groi^ps. The curriculum specified materials to be xosedt 
glQb2d. pv^il -performance goals to be obtained, and micro-t^jectives 
describing tasks that pupils should have been able to perform. 

As the pupils progressed through the grades, their contact 
with the second lamguage was to increase from 10% of the school day at 
the beginning of the prekindargarten, kindergarten, and first grade to 
one-half day in each language in third and fourth grades. Hhe pre- 
kindergarten and regular kindergarten levels of the program, met for a 
half-^day of school; the otl^er levels had full -day programs • 
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Beginning In the second operational yeaxr a epeclal all- 
day kindergarten program was developed in %4iich pupils began reading 
preprimer naterials in their mother tongue. This plan was maintained 
in 1972-1973, and alumni of the 1971-1972 all-day kindergarten were 
enrolled in a specially enriched first-grade curriculum. 

An innovation in the MDDEL A program developed in 1972-1973 
was the initiation of out-of -grade instruction, especially in the second 
language. As the program cycled upward i pupils \iho had not had bilin- 
gual educational experience entered the classes. These pupils were 
assigned to the teachers working at the a^ppropriate instructional level 
in their first and second languages even if most pupils in the teacher's 
class were at another grade level r 

MODEL B . ah is prograun sought to bring a bilingual school 
experience to smaller groups of English and Spanish -speaking pupils with- 
in a school which was not reorganized as a bilingual program. According 
to the original plan at each site, at least two classes in one grade 
level — one class consisting of Spanish-dominant children and one consisting 
of English-dominant children — were to participate in the program. Classes 
received second-language instruction from specialists in those sub- 
ject areaa. The classroom teachers had to be native speakers of the 
language in which they instructed the students. 

This program was in operation in the Miller and Ludlow elemen- 
tary schools . The MDDEL B program wets witl^drawn from the Bethune- 
Wtight school because there were fewer Spanish-speaking pupils in the 
school than anticipated. 

In 1972-1973 r the MODEL B program did not operate in accorf* 
dance with the above plam, because principals withdrew their English- 
spealcing children from the program. Detailed discussion of the principals' 
actions is included in Study 4. 

The instructional program and objectives of MODEL B 
paralleled those of MODEL A, except tliat new c\irric\ilar materials pre- 
pared in Miami by the Spanish Curriculum Development Center were used 
extensively in MDDEL B. 

ARRIBA. The ARRIBA program continued during the third 
operational year to offer grade- level-appropriate instruction using 
the Spanish language in science r mathematics , social studies r and 
Spanish aa a first language. English as a second language also was 
provided for students at all sites r as in previous years* 



- 2 - 



Pupils In Grades 3-12 were served, w vch the Instructional 
foroat artlcnilated to xnset the demands of each instructional level. In 
the elep^entary school the program was operated in self-contained class- 
rooms. In the junior high school, where jpupils moved from class to 
class for each subject, students were in Bilingual Program classes for 
part of the day and received instruction with Anglo classmates for the 
remainder. In the senior hi^ school students had individual rosters, 
permitting the selection of courses from among those offered by the 
ABRIBA component. 

The ABRIBA program was operational in Ludlow, Waring and South- 
wark elementary schools, Stoddart-Plcisher and Penn Treaty juTiior hi^ 
schools, and William FBxin, Benjamin Franklin, Thomas Edison, and Kensing- 
ton hig^ sdxools. Soutliwark school was added to the program when classes 
from Weuring elementary school v*ere bussed there in order to Improve 
integration. 



Pupils Served 

At the end of the 1972-1973 school year the three components 
of the Bilingual Program wexe serving a total of 1,834 students. Of 
those answered the questionnaire, 1,110 said that they spoke mainly 
Spanish in their homes, 384 said tttat they spoke both Spanish and 
English, and 523 spoke mainly English. Seven hxindred thirty-eight 
students were bom in Puerto Rico, 925 v^re bom on the United States 
mainland, and 31 were bom in Spariish -speaking areas other than Puerto 
Rico, 

There were 1,189 stxidents in MODEL A, 571 speaking mainly 
Spanish, 88 speaking both Spanish suxd English, and 515 speaking mainly 
English. In MODEL B there were 17C students, 146 of whom spoke mainly 
Spanish at home and 24 of whom spoke both English and Spanish. Of the 
475 students in the ARRIBA program, 393 spoke madnly Spanish at home, 
72 spoke both Spanish and English, and 8 spoke mainly English. 



S chool Disruptions 

The program operation was disrupted by two teacher strikes, 
and the illness and death of one of th program supervisors I 

Many class days during 1972-1973 were lost due to an extensive 
teachers' strike. Schools opened 17 dayr late on Septe]ii:>er 29, and 
were virtually closed for 38 days between Jariuary 8 and February 28. 
Sixteen days were made up by keeping scdiools open on holidays, during 
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regular vacation periods r and throughout the month of June. Because 
striking occurred at two different tin^s during the year^ instruction 
was segmented and students did not have an opportunity to really settle 
into a long period of school. The project director felt that two weeks 
of progress were lost for every week during which schools were closed* 
The evaluation was affected in that end-of-year testing was delayed as 
long as possible in an effort to allow a maxlraum of instructional time 
before tests were administered. The planned log study was omitted 
because the updating of micro-objectives could not be completed early 
in the year because teachers were striking r and because the time required 
to test the students with this Instrument seemed excessive in view of 
instructional time already losn. 

The program suffered a great loss in the Illness and death 
of Ramona Rodriguez, who had supervised the ARRIBA teacher training and 
curriculum development. The tes^porary adjustments which were made in 
supervisory rolws due to her illness could not cou^pensate for the 
experience and skill which she brought to this role. Her loss will con- 
tinue to be felt by all involved in the program. 



Program Operational Cost 

Tiable 1.1 shows the estimated expenditures from Title VII fvmds 
for operating the LET'S BE AMIGOS program (excluding evaluation and 
audit costs) . These remained virtually the same as those occurring in 
the 1971-1972 school year ($165 per pupil) as rising salaries were offset 
by periods for which striking personnel were not paid and the payment 
of increased nuiribers of faculty teachers out of the School District's 
general operating budcjet. The figure represents a considerable reduction 
over the costs of two years ago (See Offenberg et al., 1973, p.iv) 
when the costs were about $340 per pupil. 



Coinmanity Relations Activities 

As most coimniuiity-relatlons activities were reviewed in the 
1973-1974 proposal, only an abstract is presented here. This abstract 
has been updated to include events through the end of the fiscal year. 

During the 1972-1973 school year numeroxis of gatherings were 
attended by pupils, parents, and staff. The Bilingual* l^rogram initiated 
10 holiday celebrations, six meetings involving bilingual teachers, 13 
activities which shared information related to needs of tha comnunity 
euid services being offered, and 10 meetings (some of which were for 
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planning) for parents of children in the Bilingual Program. 

Ninety-Height activities of other comnunity groups not directly 
related to the Bilingrual Program received participation^ including 
events to promote awareness, understamding^ and cooperation in the com- 
munity, cultural events,, and meetings to give tribute to groups and 
individuals * 



Curriculum Development 

Objective 1.5 of the ARRIBA con^nent stated that, where 
needed, curriculum materials would be developed for that component. 
Since the initiation of the program, curriculxim materials have also been 
developed for the MODEL A and MODEL B programs, although no specific 
objective in the proposal mandated that this be done. 

During the fiscal year ending in June 1973, curriculiim 
writing involved 11 teachers working in the program and £»ix teacher;, 
specialists who were with the Philadelphia schools but not teaching 
in LET^S BE AMIQOS. The en^phasis in curriculum development has 
changed from primarily developiaent of new materials to adaptation of 
existing English-language materials v*iere possible and preparation of 
new materials only when necessaury. According to the coordinator of 
curriculum development, this change in emphasis was due, in part, to 
problems discussed ir Study 3, which focuses on evaluation of some 
original materials. 

The following con^leted materials were adapted from School 
District of Philadelphia curricular materials and are available for 
tryout: 

. LA VIDA EN LAS CIUDADES, PUEBLOS Y FINCAS DE PENSILVANIA. 
Social studies teacher's guide for the intermediate 
grades {4 throu^ 6) 

. CQMD EL AMBIENTE PISICO APECTA LA FORMA DE VIDA EN EL 
HEMISFERIO OCCIDENTAL. Social studies teacdier's 
guide for the inteni^diate grades 



SCIENCE FOR THE INTERMEDIATE GRADES: ELECTRICITY AND 



imOIErrZSM {in Spanish). Teacher's gxiide 

. SCIENCE FOR THE INTERMEDIATE GRADES: SOUND (IN 
SPANISH). Teacher's guide 

. LA TIESRA EN EL ESPACIO (UNITS I, II, AND III) . 
Teacher's guide for the interxnediate grades 

. SCIENCE FOR THE INTERMEDIATE GRADES: SUPPIfiMENTARY 
MATERIAL FOR MAGNETISM, ELECTRICITY (and other units 
yet to be trajislated) . Teacher's guide. 

In addition to the ad^tation of existing School District 
materials, one set of Spanish-as-a-flrst-language jnaterials was adapted 
from other sources: 

. LA LITERATUSA PUERTORRIQUENA contains a short story, 
two plays, and a novelette, all adapted for use in the 
classroom. 

The following original materials were released for dis- 
tribution during 1972-1973: 

. TU Y TU VIDA: LA SQLEDAD is an intermediate-grade 

material designed to give Spanish-speaking pupils infor- 
mation about dangerous drugs. It consists of a teacher's 
guide and a workbook. 

. MIS PRIMEBOS PASOS CON LAS VOCAIfiS is a teacher's manual 
and two workbooks designed to develop reading readiness 
in Spanish (in the prekindergarten, kindergarten, and 
first grade) . Development of these materials was begun 
several years ago, but the final version was prepared 
for release in 1972-1973. 

. MIS PRIMEROS PASOS A LA I£CTURA is a student workbook, 
designed for use with the primer levels of the Laidlaw 
Reading Series in Spanish. It is meant for kindergarten 
and first grade. 

4 PUERTO RICAN HISTORY AND CULTtTlE: A TEACHER'S RESOURCE 
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UNIT is an English-language set of materials to be used 
by teachers, both within and outside the program. It is 
designed for junior high sdiool pupils. 

As was the case in past years ^ a curriculum-evaluation check 
list was developed for use in determining whether materials were being 
produced which met quality criteria established for the program* Tliis 
year's diecklist (shown in Table 1.2) contains some questions added to 
those used in the past, in order to in^rove control of the curriculum-- 
development process (QuestioAa^ 2i 3, 14, 15 , 16 ax\A 17). 'The ratings 
were made by the project's coordinator of curriculum development. 



TABI£ 1.2 COORDINATOR OF CURRICULUM DEVELOPMENT'S REVIEW OP 11 SETS 
OF MATERIALS COMPLETED AND RELEASED IN 1972-1973 









No. of Units 






Character i s ti c 


Having 
Character- 
istic 


Not Having 
Character- 
istic 


Qiaracteristic 
not 
Applicable 


1. 


J^^ppropriateness for 
intended grade level (s) 


10 


0 


1 


2. 


Intended grade level (s) 
indicated on cover 


8 


2 


1 


3. 


Subject matter area indi- 
cated (if not clear from 
title itself) 


8 


2 


1 


4. 


Appropriate for students ' 
cultural badcground, in-- 
terest level t and 
experiential field 


9 


1 


1 


5. 


Appropriate for students' 
previous knowledge in the 


5 


0 


6 



subject matter 



mc 



in 
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TABLS 1.2 (cont'd) 



Characteria ti c 



6. Specific behavioral 
objectives clearly 
stated at beginning 
of each 0ection or 
lesson 



Having 
C3iaracter- 
istic 



No. of Units 



Not Having 
Chauracter- 
istic 



Characteristic 
not 
Applicable 



Sequential organization 
and structure 



8 



8. Testing procedures and 
xnaterials included 



9* Reasonable variety of 9 
learning activities 

10. Provision for individual 4 
rate of learning 

11. Provision for enrichxnent 7 
or extended practice 
activities 

12. Availability of audio- 7 
visual or other equipjnent 
needed to teadi the unit 

13 « Aids and xoaterials needed 7 
to teach unit: how teacher 
inay make them or vdiere 
available 



6. 
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i 

i 

I TABLE 1,2 (cont'd) 

i 
I 

? 
! 

I 14. unit is 

i 

i 4 coapletely original 

1 adapted from coxnmercial material 

6 translation of unit of School District of Philadelphia 

15. Material is 

6 t eacher's guide 
1 student workbook 

!■■ ■■ — -^1— ■ 

4 both teacher's guide and student workbook 

; 16. An additional translation of unit would be valuable 
i 2 in English 

0 in Spanish 

9 translation already exists in needed language 

17. Ajpproval for copyric^ted materials included in unit 
0 needed 
11 not needed 
0 already obtained in writing 
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As can be seen in the table, the conplated materials mset, 
for the toost part, the deasands of the curriculuxa~developnent process. 
The two areas in which most of the materials fad.1 to meet them are 
Items 8 and 10; roost materials did not include adequate testing pro- 
cedures and most did not include provision for individual rates of 
learning. According to the curriculum-development coordinator, these 
deficiencies developed because the English materials used in producing 
the Spanish versions also lacked these elements. However, a lack of 
testing procedures was also characteristic of other project-developed 
materials in previous years. 

Several other sets of materials were also being developed 
during 1972-1973, but were not yet c»inpleted or released for generad 
distribution: 

. ENGLISH: YOUR SECOND LANGUAGE, for ESL, in Grades 5-7 

. EL RECIAN LLEGADO, GIGANTES BORINCANOS, UNA C^BTA, 
BUSCANDO EMPLEO, SALIENEO DEL CINE, UN COMPROMISO 
FORMAL revision of Muckley units for SFL in Grades 
10-12 

. ROBERTO CLEMENTE— EL HOMBRE, EL ATI JTA, EL HERDE, for 
in SFL, Grades 10-12 

, LET'S READrf A PROGRAM OF READING READINESS Iti THE 
ELEMENTARY GRADES for ESL in Grade 3 

. CANCIONES INFANTILES for social studies in prakind«r- 
garten through Grade 2 

. HABIiEM:)S , NINOS . , Level D SFL in Grades 2-3 

. TU Y TU VIDA PT. II for drug education and social 
studies in Grades 4, 5, 6 

. MIS PRIMBROS PASOS OON LAS OONSONANTES Y LAS SILABAS 
for SFL in Grades K-2 
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Suxnctver Ins'iitute 



A Suiranar Teacher-Braining Institute was held in conjunction 
with Teiqple university « The institute was designed to train native 
Spaniah--6peakers with two years of college. Upon coa^letion of the 
program, participants were awarded emergency certification by the State 
of Pennsylvania. Twenty teachers were trained in the 1972 suxsaoar insti- 
tute for Spanish-speaking prof essionals « All twenty completed the 
program and were an^loyed in the various bilingual programs in the city* 



Evaluators' Oomment 

The changes reported in the foregoing sections generally 
reflect evolution of the program and continued progress in fulfilling 
the plans set in the proposal documents* However ^ two events reported i 
the strikes and the death of Mrs* Rodriguez # were es^cted to have 
major iurpact on the performance of the student target groups. It is 
therefore important that the reader keep in mind that the 1972-1973 
year was atypical — a fact that was likely to tes^rarily reduce the per* 
formance of the student participants. 
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STUDY 2 



REOIRGANIZATION OF MDDEL A AKD MODEL B MICRO-OBJECTIVES IN LANGUAGE ARTS 
SCIENCE, SOCIAL STUDIES, AMD MATHEMATICS INTO A OONTINUOUS SEQUENCE 



Since the inception of the Bilingual Program LET'S BE AMIGOS, 
instruction has been guided by the Pvipil Log s, a set of lists of micro- 
objectives "used in MODEL A and MOIffilL B in hoth first-and second-language 
instruction in language arta, social studies, science, and xnathematics . 
Each year new micro-objectives were added as the program cycled upward 
throu^ the grades, and each grade level had its own specific list of 
items. Each year (see Offenberg 1971, 1972, 1973) students were tested 
with the list of micro-objectives specified for their grade , from pre- 
kindergarten to grade three. One problem with these logs was that 
they were not internally consistent, i.e., some objectives which were 
assigned to hi^er grade levels appeared to teachers to be easy, and 
others assigned to early grades appeared to be difficxilt. One aim of 
the present study is to put the objectives in order of difficulty. 

During the 1971-1972 sdiool year, it became ^parent that the 
infuaion of new students into the program at various grade levels reduced 
the fit of the grade-level-by-garade-level list of micro-objectivws with 
the instructional program as it was being inplemented. 

These problems indicated a need for the adoption of a "con- 
tinous primary" ^proach to program evaluation—an approach which peradts 
pupils to work through their curriculum at a pace consistent with their 
past experiences and abilities. 

When in the 1972-1973 sdiool year prolonged teacher strikes 
forced a reduction in the amount of testing which could be carried out, 
application of the logs was tei^porarily dropped. Instead, a revision 
of the log was undertaken in anticipation of 1973-1974. 

The purpose of this revision was to change the log instruments 
from a year-by-year format to a set of micro-objectives whidi increase 
monotonically in difficulty in each subject area. 

To accomplish this task, teachers with ejqpertise in each 
curricular area (language arts, science, social studies, and mathematics) 
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were asked to put objectives in what they considered to be the appro- 
priate order. 

Next year, the newly organized logs will be administered to 
pupils in various grade levels with various ainoiints of Bilingucd Program 
eaqperience. The revised log will then permit description of these diverse 
seta of student grox;^ on a coosnon scale, and thus enable the project staff 
to assess the impact of the program on the various groups. 



Procedure 

Evaluation 

In order to reorganise the items in the logs, teadiers who 
knew the subject areas represented by micro-^jectives were asked to 
review them and order them from those which should be taught first to 
those whidhi should be tau^t las*:* S^pervisors designated a total of 16 
teachers yAio were the most familiar with teaching the areas. 

As shown in Table 2.1 theie were between three auid five teachers 
to rate the items in each subject area. 



TABLE 2 ^ . 1 ^ Npy^ R Of^ ^ F P^ i P^ i 1 ^??*^^^ ^^P^ 
Subject Area No. of Raters 



Mathematics 

Science 

Language Arts 

Social Studies 

Total 16 



4 

5 
4 

3 
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In the ori :nal logst soiiia micro-^ objectives appeared more than 
once because the Initial classification by language and grade level 
permitted repetition » When the repetitions were eliminated ^ there were 
252 distinct concepts » Ae in the original classification of the micro- 
objectives, these concepts were categorized by content into four subject 
areas — mathematics , science, language arts, and social studies— and a 
deck of cards was prepared fdr each* The nuni^r of itaios in each of the 
four decks is shown in Table 2.2 . 



TABLE 2.2 NUMBER OF ITEMS BY SUBJECT ABEA 



Subject Area No. of Items 

Mathematics 74 

Science 29 

L2Lnguage Arts 79 

Social Studies 70 

Total 252 



Sufficient copies of the decks were made for the raters in the 
subject areeuB, and each deck was shuffled to remove any ordering of the 
micro-s>bjectives. Wie teachers were asked to order the micro-objectives 
from those which should be tau^t first to those v^ch should be taught 
last. They were told to do so in the way that would be fairest, regard- 
less of the mother tongue of the grade level of ^he pxspil to be tested. 
Thoy worked independently, each teacher making the judgment without con- 
sultation with other teachers rating the same objectives. 



Analysis 

Analysis of the data was designed (a) to see if there was suffici- 
ent agreement among teacher-raters to determine a clear ordering which 
could be used in the program, and (b) to determine the best ordering once 
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this was established. The specific analysis for each of the four subject 
areas was as follows: 

1. Each teadier*s responses were ranked^ assigning the 
nunber to the laicro-objective to be taught first # 
2^ to the one to be taugfit second, etc. 

2. The Kendall coefficient cf concordance W was calcuJ.ated 
to assxare that the ranks given by the teachers for each 
area were similar (See Segal, 1956, pp. 229-238). 

3 • The mean of the ranks assigned by the teachers to each 

itom was calculated and the micro-objectives were reordered 
according to these means . 



Results 



As shown in Table 2.3, there was hi^ agreement in the teachers* 
decisions in ordering micro--6bjectives from those to be taught first to 
thos^ which should be tau^t later in the program. 



TABLE 2.3 




OP AGREEMENT 


MK)}HG RATEKS 




Subject 


w 


Chi- 
square* 


df 


P 


JMathematica 


.82 


239.44 


73 


.001 


Science 


.85 


119.00 


28 


.001 


Language Arts 


.87 


288.84 


83 


.001 


Social :Jtuclies 


.90 


186.30 


69 


.001 



*Chi-square equivalents were calculated in order to show the 
level of significance of the coefficients. 



To test the significance of W, chi-square equivalents were 
coiqputed. The chi -square values in the table ahaa that the agreement in 
the ranking of the it^os in each subject area was hi^ enough to be sta* 
tifltically significant: none could be due to chance more than once in 
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1,000 tiroes* Tables 2.4| 2.5, 2*6^ and 2.7 show the micro-objectivea 
for the four subject areaa in order of their saean rarJc. The tables 
also show the original grade level at vdiich each sdcro-objectives first 
appeared in the program of pupil work in the first language. Many of 
these objectives were introduced in later grade levels in the second 
language in the original logs. 
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TABLE 2.4. SBQUEMC& OF MICBO-OBJECTIVES FOR LANGUAOE 

ARTS 





Micro-objective 


Original Level* 


!• 


Mhat is your naioe? 


Prekindergarten 


2, 


Touch your eyes. 


Prekindergarten 


3. 


Touch your nose« 


Prekindergarten 


4. 


How old are you? 


Prekindergarten 


5. 


Touch your fee*;. 


Prekindergarten 


6^ 


Touch your head. 


Prekindergarten 


7. 


Identify xnouth. 


Kindergarten 


3. 


Identify ears. 


Kindargarten 


9. 


Identify teeth. 


Kindergarten 


10. 


Identify hands. 


Kindergarten 


11. 


Identify face. 


Special First Grade 


12. 


Identify fingers. 


Kindergarten 


13. 


Identify arms. 


Special First Grade 


14. 


Identify legs. 


Special First Grade 


15. 


Where do you live? (Coiqplete sentence) 


Kindergarten 


16. 


When you look, you use your (ayes) . 


Prekindergarten 


17. 


When you run, you use your (legi) 


Prekindergarten 


18 • 


Identify red. 


Prekindergarten 


19. 


VQien you listen, you vxse your (ears) 


Prekindergarten 


20. 


Identify yellow. 


Prekindergarten 


21. 


Sit down. 


Kindergarten 


22. 


Identify blue. 


Prekindergarten 


23. 


Stand 1^. 


Kindergarten 


24. 


On what peurb of your body do you put your shoes? 


Prek indergart en 


25. 


What do you do with your eyes? 


Grade 2 


26. 


Run. 


Prekindergarten 


27. 


Jus^. 


Prekindergarten 


28. 


What do you do with your legs? 


Grade 2 


29. 


Identify green. 


Prekindergarten 


30. 


What do you do with **oiar ears? 


Grade 2 


31. 


Identify black. 


Kindergarten 


32« 


Hop. 


Prekindergarten 


33. 


Identify white. 


Kindergarten 


34. 


Skip. 


Prekindergarten 


35. 


Identify pink. 


Special First Grade 


36. 


Identify brown. 


Kindergarten 


37. 


What color are your eyes? 


Prekindergarten 


38. 


What is your address? 


Prekindergarten 


39. 


Identify gold. 


Special First Grade 



TABLE 2.4 (conf d) 



m cro-'-Qb e c t ive 



Original Level* 



40. 
41. 
42. 
43. 
44. 
45. 
46. 
47. 
48. 
49. 
50. 
51. 
52. 
53. 
54. 
55. 
56. 
57. 
58. 
59. 
60. 
61. 
62. 
63. 
64. 
65. 
66. 
67. 
68. 
69. 
70. 
71. 
72. 
73. 
74. 
75. 



What color is your hair? 
Identify silver. 
Show lo e 

Get lae the > 
Give me the 
Get the . 



Who is he/she? 

Pass the . 

Identify chair. 
Identify T.V. 

Where do you go to school? 
Identify bed. 
Identi^ bedroom. 
Identify kitchen. 
Identify bathroom 
Identify living room. 
Identify dining room 
Identify lamp. 
Identify sofa. 
Identify table. 
Identil^ bathtub. 
Identify sink. 
Identify toilet 
Identify refrigerator. 
Identify stove. 
Identify rug. 

Identify capital letters in own name. 

Print own name. 

Identify toaster. 

Identify mixer. 

Identify vacuum cleaner. 

Identify b\ireau. 

Identi:^ washbasin. 

Identify buffet. 

Identify china closet. 

Word pairs beginning with same letter 



76. Word pairs beginning with same letter 

77. Given a word# list orally others with 
initial soimd. 



Prekindergarten 
Special First Grade 
Kindergarten 
Prekindergarten 
Prekindergarten 
Kindergarten 
Prekin(tergarten 
Kindergarten 
Special First Grade 
Special First Grade 
Prekindergatrten 
Special First Grade 
special First Grade 
special First Grade 
Special First Grade 
Special First Grade 
Special First Grade 
Special First Grade 
Special First Grade 
Special First Grade 
Special First Grade 
Special First Grade 
Special First Grade 
special First Grade 
Special First Grade 
Special First Grade 
Kindergarten 
Kindergarten 
Special First Grade 
Special First Grade 
Special First Grade 
Special First Grade 
Special First Grade 
Special First Grade 
special First Grade 

I (mama-mono) 

(mama-libro) special First Grade 
\ (four-^five) 

(four-six) Special First Grade 

same m ^ ^ 

Grade 2 
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TABLE 2.4 (cont'd) 



Mlcyo-ob jectlvQ Original Lj^vel* 

78, Orally^ use word houaea or people in a short 

sentence* Grade 2 

79 « Given a word, list orally others with saxne ending 

sound. Grade 2 

80 « Write sentences based on words written on the 

board. Grade 2 

*Sonie micro^-ob jectdvQs were reentered in several grade levels ' logs 
The earliest grade level in wbidh the micros-objective appeared in the 
log is shown in this column. 




TABLE 2.5 SEQUENCE OP MICRO-OBJECTIVES FOR MATHEMATICS 



Micro"objective 



Original Level* 



1. 
2. 
3. 
4. 
5. 

6. 

7. 

8. 

9. 
10. 
11. 

12. 
13. 

14. 
15- 
16. 
17. 
18. 
19. 
20. 
21. 
22. 
23. 
24. 
25. 
26. 
27. 

28. 
29. 

30. 
31. 
32. 
33. 
34. 
35. 



Coiint from one to five. 
Cowt from 1 to 10. 

Which is heavier, the book or the pencil? 
Cotint from 1 to 12. 

Recognize numerals from 1 to 10 shown out of 
sequence 



Prekinc3ergarten 
Prekindergarten 
Prekindergar ten 
Kindergarten 

Kindergarten 



How many items do you have? (Give 2 to 10 objects) Prekindergarten 



Pick object which approximates a circle. 
Pick object which approximates a square. 
Pick object which aj^Jroximates a triangle. 
Pick object which approximates a rectangle. 
Using objects, add one more. How many do you 
have now? 

Add two groups of objects (total less than 10) 
Matdi (children to chairs) 

(children to pencils) 
Separate objects into similar pairs. 
Count from 1 to 100. 
9 + 4 « 
6 + 9 - 
5 + 8 « 
8 + 9 » 
15 - 6 « 
13 - 8 » 
17 - 9 » 
Identify nickel. 
Identify dime. 
Identify quarter. 
What nunber comes before 20? 
Using a clock, indicate (one hour) 

(half hour) 

How many days in a week. 

Identify (pint) when shown containers. 

(quart) whan shown containers. 

2x7- 

5 + 2 + 4 - (vertical) 

Tell time when shown a specific hour. 

Count by 2 up to 10. 

Count by 5 up to 30. 

3x4- 



Prekindergarten 
Prekindergarten 
Prekindergarten 
Prekindergarten 

Prekinderga rten 
Prekindergarten 

special First Grade 

Kindergarten 

Special First Grade 

Grade 2 

Grade 2 

Grade 2 

Grade 2 

Grade 2 

Grade 2 

Grade 2 

Special First Grade 
Special First Grade 
Special First Grade 
Grade 3 

Special First Grade 
Grade 2 

Grade 2 
Grade 2 
Grade 3 

Special First Grade 
Grade 2 
Grade 2 
Grade 2 
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TtSLE 2.5 (cont'd) 



Micro-cbj active Original Ldvel* 



36. 


Count by 10 iqa to 100. 


Grade 


2 


37. 


5x3- 


Grade 


2 


38. 


How many months in a year? 


Grade 


2 


39. 


14 7 - 


Grade 


2 


40. 


Divide a circle into halves. 


Grade 


2 


41. 


How xoany halves in a whole? 


Grade 


2 


42. 


12 r 4 = 


Grade 


2 


43. 


Vlhich one shows ^ of a circle? 


Grade 


3 


44. 


Divide a square into fourths. 


Grade 


2 


45. 


15 I- 5 « 


Grade 


2 


46. 


How much of the circle is dark? 


Grade 


3 


47. 


18 - 2 » (vertical) 


Grade 


3 


48. 


% of 6 * 


Grade 


2 


49. 


>, of 8 - 


Grade 


2 


50. 


How memy minutes in an hour? 


Grade 


2 


51. 


How many quarters in one dollar? 


Grade 


3 


52. 


2 X 4 • (vertical) 


Grade 


3 


53. 


31 - 3 « (vertical) 


Grade 


3 


54. 


Identify tablespoon. 


Grade 


2 


55. 


How many 10 *s in 327 


Grade 


3 


56. 


2 12 « 


Grade 


3 


57. 


Use of decimal notation of money: $.10 


Grade 


2 


58. 


Use of decimal notation of money: $.25 


Grade 


2 


59. 


Co\3nt by 5's up to 50. 


Grade 


3 


60. 


12 X 2 « (vertical) 


Grade 


3 


61. 


Read the following aloud: $2.60 


Grade 


3 


62. 


22 + 36 + 25 .« (vertical) 


Grade 


3 


t>3. 


How many I's, lO's, and lOO's in 125? 


Grade 


3 


64. 


9 X 8 - (vertical) 


Grade 


3 


65. 


3 64 - 


Grade 


3 . 


66. 


Read the following aloud: 253 


Grade 


3 


67. 


Count backward from 50 to 10 by 10 's. 


Grade 


3 


68. 


Ra&d the following edoxidt 845 


Grade 


3 


69. 


What nuiober is 2,635? 


Grade 


3 


70. 


Add: 2.43 -t- 1.51 (vertical) 


Grade 


3 


71. 


What comas beicro 4257 


Grade 


3 


72. 


(2 X 10) +(5x1) - (accept (20+5) or 25 


Grade 


3 


73. 


Read the following Roman nuiober: VI 


Grade 


•\ 


74. 


Read the following Roman nus&>er: IX 


Grade 





♦Soaie nilcro-obj actives were reentered in several grade levels' logs* 
The earliest grade level in which the micro-objective appeared in the 



log is shown in this column* 



TABLE 2.6 SEQUENCE OP MICSD-OBJECTIVES FOR SCIENCE 



Micro-objective 



Original Level* 



1. Identify dog from picture. 

2. Identify cat from picture. 

3. Identify bird from picture. 

4. Identify apples from picture. 

5. Identify horse fxrom picture. 

6. Identify cow from picttire. 

7. Identify bananas from picture. 

8. Identifyr oranges from pictiure. 

9. Nhat do we wexc when it's hot? 

10. vafiat do we wear when it's cold? 

11. Identic potatoes from picture. 

12. Identify sheep from picture. 

13. Place correct weather synibol on chart. 

14. Identify roses from picture. 

15. Identify lion in a sentence. 

16. Identify tiger in a sentence. 

17. Identify bear. 

18. Identify duck. 

19. Identify turtle. 

20. Identify chicken in a sentence. 

21. Identify gorilla. 

22. Identify goat. 

23. Identify frog. 

24. Identic cherries. 

25. Identify spinach 

26. Identify daisies. 

27. What dissolves in H2O? 

28. What does not dissolve in B2O? 

29. How does the weather change? 



Pzekindergarten 

Prekindergarten 

Prekindergarten 

Prekindergarten 

Prekindergarten 

Prekindergarten 

Prekindergarten 

Prekindergarten 

Prekindergarten 

Prekindergarten 

Prekindergarten 

Prekindergarten 

Prekindergaii:en 

Prekindergarten 

Kindergarten 

Kindergarten 

Special First Grade 

Special First Grade 

Special First Grade 

Kindergarten 

Special First Grade 

Special First Grade 

Special First Grade 

Special First Grade 

Special First Grade 

Special First Grade 

Grade 2 

Grade 2 

Grade 2 



is 



•Some micro-obje'^tives were reentered in several 
earliest grade level in which the micro -objective 
shown in this column. 



grade levels' logs, 
appeared in the log 
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TABLE 2.7 SEQTJENCE OP MICRO-OBOl CTIVES FOR SOCIAL STUDIES 



Micro-^jective 



Original Level* 



1. 

2. 

3. 

4. 

5. 

6. 

7. 

8. 

9. 
10. 
11. 
12. 
13. 
14. 
15. 
16. 
17. 
18. 
19. 
20. 
21. 
22. 
23. 
24. 
25. 
26. 
27. 
28. 
29. 
30. 

31. 
32. 
33. 
34. 
35. 
36. 



Identify policemem from picture . 
Identify police car. 

Match the pictures of policeman-police car 

Why is the police car ijDHportant to the policeman? 

Identify doctor from picture. 

Identify fireman. 

Match the pictures of fireman-fire engine. 

Identify ceur from picture. 

Identify nurse from pictxure. 

Identify fire engine. 

What is the anfijulance used for? 

Who do we call when a fire starts? 

How does the fireman help ub? 

What is the fire engine used for? 

Why is the fire engine important to the fireman? 

Identify milkman from picture. 

What school are you in? 

Identify milk truck. 

What is your teadher's nana? 

Matdi the pictures of milkman-milk truck. 

What grade are you in? 

Why is the milk truck ia^portant to the milkman? 

What days do we come to school? 

Identify mailman. 

What ia your mother's name? 

What is your father's neune? 

Identic newspaper boy. 

Identify garbage collector. 

How m2uiy sisters and brothers do you have? 

Identify and talk about family members from 

picture . 

What is your sister's/brother's name? 

How does the trashman help us? 

Identify bus from picttire. 

Where do we go when we want to buy stan\p37 

Identify trolley from picture. 

Where do we go when we want books? 



Preklndergarten 
Kindergarten 
Special First Grade 
Grade 1 

Prekindergarten 

Prekindergarten 

Special First Grade 

Prekindergarten 

Prekindergzurten 

Kindergairten 

Grade 2 

Grade 2 

Grade 2 

Grade 2 

Grade 1 

Prekindergarten 
special First Grade 
Kindergarten 
Special First Grade 
Special First Grade 
Special First Grade 
Grade 1 
Kindergarten 
Kindergarten 
Special First Grade 
Special First Grade 
Speciaa First Grade 
Special First Grade 
Kindergarten 

special First Grade 
Specietl First Grade 
Grade 2 

Prekindergarten 
Grade 2 

Prekindergarten 
Grade 2 
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•TABLE 2.7 (cont'd) 





Micro-bb:i ecti ve 


Original Level* 


37. 


Describe use of traffic li^t. 


Grade 


2 


38. 


Describe use of stop sign. 


Grade 


2 


39. 


Why don't we go to the shore in the winter? 


Grade 


3 


40. 


Kinds of weather in winter but not in suuansr in 






41. 


Philadelphia 


Grade 


3 


Difference between winter and sunmisr clothes in 








Philadelphia. 


Grade 


3 


42. 


What is the difference between party clothes and 






43. 


school clothes? 


Grade 


3 


What do plants need to grow? 


Grade 


3 


44. 


Nane some foods made from milk. 


Grade 


3 


45. 


Name some foods that grow underground 


Grade 


3 


46. 


What animals give us wool 


Grade 


3 


47. 


Why do some foods oome in cans and some frozen? 


Grade 


3 


48. 


How is manufactured clothing brought to our stores 




49. 


stores? 


Grade 


3 


Why are most trees green in Puerto Rico but 






50. 


lose their leaves in Philadelphia? 


Grade 


3 


What is a farm? 


Grade 


3 


51. 


Ho do farms help cities and towns? 


Grade 


4 


52. 


What machines do people have in their homes? 




3 


53. 


What is a city? 


Grade 


4 


54. 


Nana some things we use that are found in the 






55. 


earth. 


Grade 


3 


Name some things made of iron. 


Grade 


3 


56. 


What is an island? 


Greuie 


4 


57. 


Who was the founder of Philadelphia? 


Grade 


4 


58. 


What is a town? 


Grade 


4 


59. 


Name some things with motors in them. 


Grade 


3 


60. 


What is the capital of Pennsylvania? 


Grade 


4 


61. 


Name one bridge connecting Philadelphia 








and New Jersey. 


Grade 


4 


62. 


How do you get to Philadelphia from New York? 


Grade 


4 


63. 


Who discovered Puerto Rico? 


Grade 


4 


64. 


What are the different ways of getting the 








news to people? 


Grade 


4 


65. 


What is the capital of Puerto Rico? 


Grade 


4 
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TABLE 2.7 (cont'd) 



Micro-objective Original Level* 

66. Name two large cities in Puerto Rico. Grade 4 

67. What is the typical dish of Puerto Rico? Grade 4 

68. What is a popular musical instrument in Puerto 

I^co? Grade 4 

69. Mention some typical products of Puerto Rico. Grade 4 

7 0. What is the Three Kings' Day? Grade 4 

•Some micro-objectives' were reentered in several grade levels' logs. 

The earliest grade level in which the micro-objective appeared in the 
log is shown in this column. 
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EvaXuatora* Conanant 



The high level of agreenant auiong rater* shows that experience 
in the program has led to a clear pict\ire of the order in which material 
should be taught. It is interesting to noU, however, that in some 
subject areas there is great diaagreemant with the original statement 
of goals as reflected in the year-by-yaar- logs . 



Language Arts 

As bilingual education focuses on language performance, and 
as there is heavy einphasis on language development in the early grades 
of school, it is not surprising that many of the micro-objectives were 
in this category, it is more surprising that teachers were in sharp 
disagreement with the original logs in the order in which the concepts 
in this area were to be taught. Althou^ there was a tendency for 
kindergarten and prelcindergarten micro-objectives to appear more often 
in the first half of the instructional sequence and for first- and 
seoond-grade micro-objectives to appear later on, there was a substan- 
tial amount of mixing across the list. Itiis suggested that the original 
ordering of micro-objecUves in this area was not an appropriate guide 
for instrucUon of the pupils in the ^todel School con^nents. 



Mathematics and Scien ce 

In contrast to language arts, the mathematics and science 
teachers' ordering of micro-objectives was fairly similar to that of the 
original logs. 

In science, supervisors' review of the total nuafcer of distinct 
objectives showed that this area was probably in need of -inrichnent. The 
29 micro-objectives dealt primarily with identification and definitions, 
with only a few dealing with basic concepts which underlie the science 
curriculum used in the schools. It appears that additional attention is 
reqxiired in the science area. 
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Social Studiea 



Examination of the social stuiiee micro-objectiva list 
showed that there was general agraenent between the original logs and 
the toachera' ratings re ga. ling which aatterial should be introduced early 
in the instructional sequence and v^ich material should be introduced 
later. However, within the tvx) halves of the sequence, there was con- 
siderable mixing of grade levels. 



Scope of the Objectives 

In each area except social studies , there appeared to be 
little material which was designated in the original logs as work to be 
done in the fourth grade in the mother tongue. It is not clear to the 
evaluators whether this was deliberate or attention needed to be given 
to adding more coxi^lex skills to the language arts, science, and mathe- 
matics areas . 



Conclusions 



This study suggested that teachers want reorganization of the 
**^^r?*^ curriculum content's sequence, and that some areas may require 
addition of more conplex items. 

u agreement among raters showed that there should 

be little difficulty in adopting a "continuous primary" approach to des- 
cri?,ing pupil performance in the curricular areas. 
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STUDY 3 

EVALUATION OP THE JUNIOR HIGH SCHOOL SOCIAL STUDIES AND SCIENCE MATERIALS 
THROUGH CRITERION TESTING OF STUDENT PERFORMANCE 



A m&jor aspect of the ARRIBA cocnponent Is development and try-- 
out of curriculum material!. This study deals with tryout of two sets 
of materials for seventh-grade courses in social studies and science. 
Previous study of materials developed by program staff at the ARRIBA com- 
ponent has been informal. In the third operational year of the program 
(1971-1972) the book Hiatoria de Puerto Rico ^ assessed in this paper, was 
used by one teacher at the upper elementary level and one at the junior 
high school level. The elementary teacher felt that the materials were 
too difficult for her class. At the junior high school level it appeared 
that these materials needed supplementation auid enrichment from other 
sources, but otherwise they were satisfactory. 

During 1971-1972 one of the two sets of materials in the 
science package tested in this study w^ also tried: the set of six book- 
lets on siai^le machines ( M&?\iinas Sicgles ) . Teachers felt that these 
booklets were most suitable for ninth-grade pupils although the content 
was originally designed for seventh grade« Teachers felt that concrete 
demonstrations were needed with these materials, but there was no provi- 
sion for them and no laboratory space. A member of the research staff 
faxoiliar with the concepts presented in M&quinas Singles felt that som 
basic distinctions (e.g., between weight and mass) were unclear. 

During 1971-1972, a second set of science materials containing 
three units — Our Solar System , Our Atmosphere , and Our Weather— became 
avadlable but was not formally tried. These materials, which together 
are called Ciencia en Bapaflol , were given a systematic trial during 
1972-1973 as part of this study of seventh-grade science materials. 

In contrast to the earlier assessments of curriculum materials, 
which came from the teacher's view, the 1972-1973 evaluation focuses on 
perfoarmance of pupils in the seventh grade on criterion-referent tests 
designed to determine whether pupils had the knowledges and concepts 
which the materials were expected to teach. 

As was stated in the 1971-1972 Continuation Proposal (page 
111) , the tests were designed to have a 60% minimxM passing score, and a 
75% correct meaui score after correction for guessing. The latter score 
served as the criterion for pupil performance. 

During the development of these units, a debate occurred within 
the program regarding the effect of reading skill on tests which might be 
prepared to test pupil performance in science and social studies. The 
design which follows deals with the question of iinpact of reading skill 
on performance on tests, as well as assessment of the students' success 
in meeting i"he objective. 
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Procedures 



Program 

During the summer of 1972 outlines of program content for 
seventh-grade science and junior high schcol history of Puerto Rico were 
prepared, in October, vrtien schools opened after the first strike, the 
two teachers vrtio were responsible for seventh-grade science and the two 
teachers responsible for seventh-grade social studies were contacted by 
the Coordinator of Curriculum Development and the project Director. 
Both sets of teachers agreed to teach the content of the respective 
materials vrtiich had been developed for the project: 

» M&;uinas Simples (Simple Machines) Introduction and 5 
Booklets: Piano Inclinado, La Rueda y Polea, Otros Modifi- 
caciones de la Rueda, Las Palancais, Trabajo y Fuerza 

. Ciencia en Espanol i Nuestro sistema Solar, Nuestra Atmosfera, 
El Tiempo (Science in Spanish: Our Solar System, Our Atao- 
sphere, and The Weather) 

, Historia de Puerto Rico (History of Puerto Rico) . 

It was originally felt that pupil work with the science materi- 
als would be completed by March 1973 and the material in social studies 
would be completed by February 1973. when a second strike occurred in 
January and February, completions of the sets of materials were delayed 
until May. As a result the testing took place in early June. 

It W2IS expected that the project-developed science materials 
would constitute the main structure of the science program, with the 
teacher bringing in supplementary demonstrations, Historia de Puerto 
Rico was designed to be taught along with related historical concepts, 
which teachers introduced along with the project-developed curriculum. 
Teaching was to take place not only with the written materials, but also 
with verbal presentation and review to assure that pupils with reading 
difficulties could master the content. 



Evaltiation 

The evaluation procedure was designed to test pupil performance 
on the materials in order to see if they met the expectations of curric- 
ulum planners, it also atteii?)ted to show whether students could read 
the test content. 

Method . During the suimner of 1972, a member of the evaluation 
staff prepared a list of objective questions in Spanish covering each 
concept in the science package and Historia de Puerto Rico . The 
questions were designed to be a con«>lete review of every fact and point 
in each set of instructional materials, in other words, if a pupil 
could answer all of the questions on these lists, he knew every fact or 
concept in the material. 
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Teachers were provided with sets of the instructional materials 
and a copy of the appropriate questions. They were told that they ware 
to teach the materials (during the time periods specified in the 
"Program" section) to their seventh-grade classes. After completion of 
the materials, pupils were to be given a test baaed on the question listi 
the form of the question might be changed^ but the content would not be 
altered. 

In June 1973^ the date adopted after the strike, a member of 
the research staff visited the classes at a prearranged time and admin- 
istered the criterion tests to all students present on the day of the 
testing. 

Instrument , One test was developed for each siabject area, 
history of Puerto Rico and science. A member of the research staff re- 
wrote each question in the original list so that all questions were in 
either true/false or multiple-choice format. The research staff and the 
coordinator of curriculum development then made the final item selection. 
The exam was prepared in the form of three or four subtests. 

The science exam consisted of 20 multiple-choice items and two 
groups of ten true/false items. The history exam consisted of two groups 
of ten multiple-choice items and two groups of ten true/false items. 
Both tests are shown appended to this study (Appendix 3.1). 

Where the items were divided into two groups (i.e., the science 
true/false items and the history multiple-choice and true/false items) , 
this was done to permit assessment of the effect of students' reading 
skills on test performance. Items judged to be of similar difficulty 
were assigned to either of two groups — in one group to be read aloud and 
in the other to be coK5)leted by the students' own si3ent reading of the 
questions. 

Subjects ,. This testing Wt*? conducted late in June, beyond the 
normal closing date of school, and no makeup date could be scheduled. 
Many pupils were not attending school presumably because they were visit- 
ing their relatives in Puerto Rico or had left the city for some other 
reason. Absence for these reasons was added to normal absenteeism. As 
a result, 55% of the students on roll were tested in science and 60% of 
the students were tested in sooial studies. 

Administration , The tests were administered in the regular 
classroom meeting of the students. A member of the research staff was 
present to monitor. First students were given those parts of the test 
which the pupils both saw and heard. With these tests in front of the 
students the regular classroom teacher read the questions aloud and the 
students marked their answers. Then the subtests which the students were 
to read without help were distributed, and pupils worked the items 
silently* The pattern of administration in the two junior high schools 
was as shown in Tablet 3,1. This pattern is counterbalanced so that the 
effect of reading can be teas. out for all but the multiple-choice items 
of the science test. 
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TABLE 3.1. PATTEHN OP CRITERION SUBTEST ADMINISTRATION 



Subtest 



Stoddart-Fleisher 



Penn Treaty 



So-^ial Studies 






Multiple-Choice 1 
Multiple-Choice 2 
True/False 1 
r.'rue/FalSG 2 


Read Aloud 
Silent Only 
Read Aloud 
Silent Only 


Silent Only 
Read Aloud 
Silent Only 
Read Aloud 


ocience 






Multiple-Choice 
True/False 1 
True/False 2 


Silent Only 
Read Aloud 
Silent Only 


Silent Only 
Silent Only 
Read Aloud 



Analysis. Subtest and to^al scores were calculated, taking into 
account the effect of guessing. A tabulation of difficulty of each item 
was prepared which showed the percentage of pupils succeeding on each item. 

Where differences in laeans of equivalent parts were found which 
suggested that the oral presentation of questions had an effect, a t test 
was confuted to show whether the differences were greater than chance 



Results 



Observation 



Classroom observaUon of teacher-^ by the evaluation staff at the 
midpoint of the school year (five observations in all) showed that the 
materials were in use, but that one of the history teachers had problems 
Of class control and student disinterest. Prior to testing, the science 
teacher at Penn Treaty stated that despite the eiaphasis on conforming to 
the printed schedule, he did not teach the material concerning pulleys 
and inclined planes. He expected that most students would therefore be 
unable to do Items 2 and 5 on the multiple-choice and Item 9 on each of 
the two groups of true/false items. 

Testing of science Materials 

Table 3.2 shows the number of items on each science subtest, the 
score^which could be obtained by quessing, the minimum number needed to 
pass the test— that is, to score 60% correct beyond the guessing level— 
and tne number of items to score 75% beyond the guessing level. Table 3 3 
shows the actual performance of pupils on each subtest. As can be seen in 
the table, only one of the 31 pupils tested had an overall score above the 
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level for passing the test, and all the group means were well below those 
anticipated in the original objective. ^Se&ns for seventh graders on the 
multiple-choice section showed a two-item difference between the schools, 
probably due to failure to teach material related to two items on the 
test. Scores on the true false sections of the test were all approximately 
one item over the guessing level, suggesting that few pupils could really 
handle the content of these items. 

Comparison of the group means for the parts which were read 
silently by some students and read aloud to others showed differences of 
0.6 item or less in favor of the group which both heard and read the 
items, a difference which seemed too small to be educationally meaningful 
or to warrant further analysis. 



TABLE 3.2. CHARACTERISTICS OF THE SCIENCE CRITERION TEST 



Subtest 


No. of 

Items 


Guessing 
Score 


Passing Score** 
(60%) 


Objective Criterion 
Score** (75%) 


Multiple-Choi ce 


19* 


6.3 


14 


16 


True/Fa] se 1 


10 


5.0 


8 


9 


True/False 2 


10 


5.0 


3 


9 


Total 


39 


16.3 


30 


34 



*Item 4 of the original 20 items was eliminated because the illustra- 
tor neglected to include the correct answer in the choices. 



**Rounded to the nearest whole item. 
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TABLE 3.3. RESULTS OP SCIENCE TESTING IN SEVENTH GRADE 



Penn Treaty Stoddart-Fleisher Total 
(N«19) (N-12) (N-U) 



Part I (Multiple-Choice) 
Mean Score 
Standard Deviation 
No. Passing Subtest 


11.6 
3.4 

4(21%) 


9.9 
3.9 
1(8%) 


10.9 
3.6 

5(16%) 


Part II (True/False 1) 
Mean Score 
Standard Deviation 
No, Pcissing Svibtest 


5.8 
1.9 

3(16%) 


6.1* 

1.4 

2(16%) 


5.9 
1.7 

5(16%) 


Part III (True/False 2) 
Mean Score 
Standard Deviation 
No. Passing Subtest 


6.1* 

1.7 

3(16%) 


5.8 
2.3 

3(25%) 


6.0 
. 1.9 

6(19%) 


Total 

Mean Score 
Standard Deviation 
No. Passing Test 


23.5 
5.7 
1(5%) 


21.8 
6.1 

0(0%) 


22.9 
5.9 
1(3%) 



♦Test parts which were read to pupils. 

Taken together, the results of the testing of students on the 

T^T. /^''tu ^^""^^^^ ^^^^ performance was far below levels 

ejected by the curriculum development staff, and only very slightly 
above that which would be obtained by guessing on some test parS! 

Testing of Social Studies Materials 

Table 3.4 shows the characteristics of the social studies crite- 
rion test. AS can be seen on the table, it consisted of two groups of 

TABLE 3.4. CHARACTERISTICS OF THE SOCIAL STUDIES CRITERION TEST 



Subtest 

True/False 1 
True/False 2 
Multiple-Choice 1 
Multiple-Choice 2 



No. or 

Items 

10 
10 
10 
10 



Guessing Passing Score Objective Score 
Score (60%) (75%) 



3.3 
3.3 



8 
8 
7 
7 



9 
9 
8 
8 



true/false items and two groups of multiple-choice items. "True/false" 
Part 1 and "Multiple-choice" Part 1 were read aloud to the Penn Treaty 
students as they worked the teat? the students worked "True/false" Part 2 
and ••Multiple-choice" Part 2 silently. At Stoddart-Fleisher, the manner 
of presentation of parts was reversed— "True/false" Part 2 and "Multiple- 
choice" Part 2 were road aloud. 

Results of the testing eure shown in Table 3.5. As can be seen 
in the table, the social studies test also proved very difficult for the 
pupils in the program, with only four students of the 33 who consisted 
the test obtaining a passing overall score. 

As there seemed to be some overall difference in subtest means 
for the two schools, the difference between the total of Parts 1 and 3 
and the total of Parts 2 and 4 was computed for each student. If there 
was a difference in performance brought about by reading items aloud, at 
Penn Treaty the differences should be larger than at Stoddart-Fleisher 
(when sign is tciken into account) . A t^ test between these two sets of 
differences was con^juted. It showed that there was no significant differ- 
ence (t-0.53, df«31). Therefore, it appeared that ability to read the 
items was not critical in determining pupil performance. 

TABLE 3.5. RESULTS OF SOCIAL STUDIES TESTING IN SEVENTH GRADE 



Subtest 



Penn Treaty 
(N=20) 



Stoddart-Fleishsr Total 
(N-13) (N-33) 



True/False 1 
Mean Score 
Standard Deviation 
No. Passing Siabtest 

True/False 2 
Meam Score 
Standard Deviation 
No, Passing Subtest 

Multiple-Choice 1 
Mean Score 
Standard Deviation 
No. Passing Subtest 

Multiple-Choice 2 
Mean Score 
Standard Deviation 
No. Passing Subtest 



5.1 
1.5 

1(5%) 



5.9 
1.9 

4(25%) 



7.0 
1.9 
11(55%) 



6.8 
2.0 

12(60%) 



5.6 
1.3 

0(0%) 



6.5 
0.9 
0(0%) 



5.4 

2.0 

1(8%) 



6.2 
2.6 

5(38%) 



5.5 
1.1 
1(3%) 



5.1 
1.6 

4(12%) 



6.3 
2.0 
12(36%) 



6.5 
2.2 

17(51%) 



Total 

Mean Score 24.7 23.7 24.3 

Standard Deviation 4.2 5.9 4.9 

No. Passing Test 2(10%) ' 2(15%) 4(12%) 



Examination of subtest performance showed that on the true/false 
items, three of the four school subtest means were within one item of the 
guessing level. Pupils fared gomawhat better with the multiple- choice 
items, where the means were at or close to the minimum passing scores. 
Even here, however, performanca was below the 75% average score set by 
the criterion. 



Evaluators' Comment 

The results of these two studies of curriculum developed by the 
project suggest that there are serious problems in the chain which begins 
with preparation of these materials and ends with pupil performance. 
Given the clarity with which the project personnel specified early in the 
year exactly what was to be taught and tested, and the manner in which 
the tests were constructed, it seemed unlikely that the low performance 
could be attributed to the teachers' misunderstanding of what would be 
tested. That leaves two possible problems: either (a) the materials 

were unsatisfactory for teaching the desired~concepts to children in the 
program, or (b) the teachers were ineffective in teaching the content of 
the materials to their classes. 



If these materials are to be vised again with students in the 
program, it is important that there be regular observation of the teach- 
ing procedures, regular checks by project management to see that the 
students are in fact being taught concepts of the materials in a satis- 
factory mangier, and practical assistajice for those teachers who need help. 

Before they are used again, it would be important to examine 
the materials themselves in order to determine whether they provide clear 
explanations of the facts and concepts involved. To this end. Appendix 
3.1, which shows the sample tests, also indicates the page in the mate- 
rials most in need of rewriting. 
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APPENDIX 3.1 



SAMPLES OF TESTS USED TO ASSESS THE "SCIENCE" AND 
"HISTORSr OF PUERTO RICO" MATERIALS 

Included are (a) the percentage of pupils getting 
each item correct,""and (b) the source of each item in 
the texts. 
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EVALUACION DE LA UNIDAD "HISTORIA DE PUERTO RICO" 

Nombre ^ Fecha 

Escuela Grado 

Selecci6n Multiple 

Escoge la mejor contestaci6n y escribe la letra de fcta en el espacio a 
la izquierda: . 

fW^vxt* C0WC CT" 

1. Laf letras "F" e "I" en el escudo de Puerto Rico representan 

A. Francia e Italia. 

B. franjas e islas. 

C. Fernando e Isabel. ^ h 

?' 

2. La aduana es una agenda del gobierno que controla 

A. la entrada y salida de personas y productos. 

B. el ej^rcito. 

C. la rivalidad entre pafses fuertes. 

3. Dice que no deben forma r colonies en Latinoam^rica otros 

""fses la 
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A. Doctrina de I ndependencia. 

B. Doctrina de Monroe. 

C. Doctrina de Truman. ^ i 

^ Palabras tales como bohio y yuca provienen de los 

A. espafioles. 

B. franceses. 

C. Indies. p "35 

5. Ademds de escribir el poema "Canto a Puerto Rico, " Jose 
Gautier Benftez escribi& 

A. el ensayo "La Alianza para el Progreso. " 

B. una coleccidn de supersticiones. 

C. artrculos sobre la esclavitud. 
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ttS^ EVALUACION DE LA UNIDAD "HISTORIA DE PUERTO RiCO" 



Seleccidn MQitiple 

J2^ 6. Seconsidera que Puerto Rico ha sidooficialmentebilinque 
debugs de 

A. La Revolucidn Francesa. 

B. La Guerra Hispanoamericana. 

C. La Segunda Guerra 



-^^ 7. El gobierno de Puerto Rico tiene tres ramas: 

A. la f rater nidad, la igualdad. la libertad. 

B. la isla, la ciudad, la aldea. 

C. la leglislativa, la ejecutiva, la judicial 

jj^ a Los puertorriquertos son ciudadanos de Estados Unidos de 
Norteam^rica desde el aflo 

A. 1717. 

B. 1817. 

C. 1917. 

p. P6 

7g 9. El baile clisico de la cultura puertorriquefta es 

A. la danza. 

B. la jota aragonesa. 

C. elvals. 

JitSL 10. El Dr. Agustrn Stahl, nacido y criado en Alemania, combatid 

A. el vdmito negro. 

B. el sarampidn alemin. 

C. la enfermedad de la cafia de azucar. 
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tt"' EVALUACION DE LA UNIDAD "HISTORIA DE PUERTO RICO" 



i. Cierto o falso 

Escribe en el espacio en bianco !a letra "C" si fa oracidn es cierta o 

r SI es f2lS3: 

1. No se sabe qui^n fue et autor de "La Borinqjefia " 

p. ^ 

i Z La palabra jibaro proviene del nombre de una tribu afrlcana. 

JID 3. La religidn nunca ha tenido gran Influencia en las fiestas v 
diverslones puertorrlqueflas. 

Jl£ 4 Una de las diversiones durante una ttpica fiesta patronal en 
Puerto Rico es el palo ensebao. 

JL£ 5. Se ha perdldo casi toda la obra renombrada de Josg Camoeche 
mcluso"EI Velorio." ^ ' 



p. 5"^ 



6- Un ejempio de una copla del baile del sels chorreao es "La 
Noche de San Juan" de Lope de Vega. 

a If 7 p. 53 

J&O. 7. Desde pequeHo don Luis Mufioz Rivera se interesd per el 
bienestar de la gente de Puerto Rico y del mundo 

p. ^ ' 

^ PfSf'sigloXIXmuchospuertorriqueftosquerranacabarcon 
el coloniaje que ten fa Espafja en Puerto Rico. 

p. 

m 9- Luis A/lurlnoz fue un famoso santero 

^ 10. Los pueblos de Puerto Rico se fundaron mayormente alrededor 
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BtSl W WMLABIE EVALUACION DE LA UN I DAD "HISTORIA DE PUERTO RICO" 



I. Cierto o fatso 

Escribe en el espacio en bianco la letra "C" si la oracldn es clerta o 
Pe^ce^f c^liJS falsa: 

^ Un resultado de la Guerra Hlspanoamericana fue la 
independencia de Puerto Rico. 

_Vt 2. Los jibaros de hoy en dfa siguen usando una forma de 
costumbrismo criolio para expresarse. 

^- siglo XVI la importacidn a la isia de muchas imprentas 
tuvo como -esultado la publicacidn de mucha liieratura 
puertorriqueHa. 

4 Se considera a Juan Morell Campos como el sobresaliente 
genio musical de Puerto Rico. 

p. 

5. AunqueJosgCampechees el primer pintorpuertorriquerb, 
tambign se le conoce como aficionado de la rafisfca. 

jy^ 6. Durante ias fiestas de San Juan sebailabafel' seis, unbailede 
seis personas. 

p, 

_42 7. A Eugenio de Hostos se le conoce mis como politico que como 
educador. 

a Se le considera a Josd Gautier Benitez como el poeta puerto- 
rriqueno m^s grande del siglo Xf X y de todos los tiempos. 

, 7^ 9- Cuba es una posesldn de Estados Unidos. 

10. Actualmente Puerto Rico es un pars independiente. 
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^^^^^^^ 

EVALUACION DE LA UN I DAD "HISTORIA DE PUERTO RICO" 



Fecha 



Seteccidn Multiple 

Escoge la mejor contestacldn y escribe la letra de isia en el espacio a 
la izquserda: *^ 

^5 I. La bandera de Puerto Rico fue adoptada por 

A. un grupo de patr iotas. 

B. Betsy Ross. 

C. los espatloles. 

p. r 

2. El nombre del famoso pi rata puertorriqueflo tan amado y 
respetado por la gente es 

A. Fajardo. 

B. Arizmendi. 
. uorresi. 

3^ ^- Abolieron la esclavitud en Puerto Rico 

A. las Cortes Espaflolas. 

B. Roberto Cofresfy David Porter. 

C. Fernando e Isabel 



4 Unjibaroes ^'^^ 

A. un estllo de arte coloniaL 

B. un campesino puertorriquerto. 

C. un estllo de mdsica puertorriquefta del siglo XIX. 

A^L 5- santo protector de la isia de Puerto Rico es 

A. Juan Ponce de Ledn. 

B. San kiat) Bautista. 

C. Santiago de Compostela. ^ 
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EVALUACION DE LA UNIDAD "HISTORIA DE PUERTO RICO" 



ESCU8I3 Qrajjo 



Seleccidn Multiple 

Escoge la mejor contestacidn y escribe la letra de Ssta en el e^Dacio a 
la izquierda: "'^ 

7fc 6. El Hush e fildsofo y abogado Segundo Ruiz Belvis luchd a 
favor de 

A. la Operacidn Manos a la Obra. 

B. la abolicldn de fa esclavitud. 

C. ias Cortes EspaHeias. 

p. 

70 7. Ei nombre oficlai de Puerto Rico es 

A. fa Repubfica Demdcrata de Puerto Rico. 

B. el Estado Libre de Puerto Rico. 

C. el Reino Libre de Puerto Rico 

3^ a Durante los tres siglos de colonizacidn en Puerto Rico la 
ma^orFa de los fiabitantes de fa is fa vivFan en 

A. fas cuatro ciudades mSs grandes. 

B. Cufebra, Mona y Viegues. 

C. fa zona rural. 

p. n 

9. Ramdn Emeterio Betances, et LFncofn de Puerto Rico, organizd 

A. la rebelidn del Grito de Lares. 

B. el Seminario Conciliar. 

C. la Sociedad Econdmica de Amigos del Pafs. 

.51 la Se le conoce como un gran orador que entusiasmaba a fas 
multitudes con sus discursos a 

A. Juan Ponce de Ledn. 

B. Jos6 de Diego. 

^' Mariana Bracetti. ^^g. 
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|>ijiV5a\|VALUACI0N DE LAS UNIDADES "MAQUINAS SIMPLES" 



Nombre 



Fecha 



Escuela 



Grado 



Selecci6n Multiple 

Escribe un cFrculo alrededor de ia jetra corrects: 
^oo) L Para desaflojar una tuerca debe usarse: 






2. iQuS parte del tornilloesun piano inclinado? 
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k\ # EVALUACICN DE US UNIDADES "MAQUINAS SIMPLES 



II 



Nombre 



Fecha 



Escueia 



Grado 



Seleccion Multiple (ctda) 
(j^p- El destomlilador se usa para atornillar: 




B 




iCuil de las sigiientes es un hacha? 



Ovr)\ 



0 EVALUACION DE LAS UNIDADES "M AQUINAS SIMPLES" 



Nombre 



Fecha 



Escuela 



Grado 



Seleccidn Multiple (ctda) 

(4^5. Observa el dibujo. La flecha "A" esti seftalando 

a. el eje de la polea ft ja. 1 

b. la polea movible. 

c. la polea fija. 




^0)6. Para cortar un alambre debe usarse 
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0 ^^*^^EVALUACiON DE LAS UNIDADES "MAQUINAS SIMPLES" 
Nombre Fecha 



Escueia Grado 



Seleccidn Multiple (ctda) 

C3S)7. Observa el dibujo. Si los muchachos no se mueven de lugar, la 
fuerza que usa el muchacho "A" es 

a. igual a la que usa el muchacho "B". 

b. mayor que la fuerza hecha por el muchacho "B". 
c menor que la fuerza hecha por el muchacho "B". 





ja La cuna que sirve de apoyo a! tabldn se llama: 



pi 



a. herramlenta. 

b. fulcro. 

c. palanca. 




^"^^mmcm de unioades de ciencia (el sistema 
^^^^ solar, la atmosfera, el TIEMPO) 

Nombre Fecha 



Escuela Grado 

Seieccidn Multiple (ctda) 

Escoge la mejor contestacidn y escribe la letra en ei espacio a la 
izquierda: 

9. Lo interesante del Cometa Ha I ley es que C%ev\c>c^ ev% 

a. s6lo puede verse desde la iuna. : fi il 

b. pierde su luz cada diez ahos. 

c se ve desde la tierra cada 75 aflos. 

(3O 10. Los astronautas americanos caminaron per primera vez en 
la Iuna en 

a. 1957. Ci^^clcK 

t). 1%9. ^Sf • J 7 

c. 1972. 

LHB) 11. Entre Marte y Jupiter hay un sinnumero de pedazos de 
uno 0 varies planetas que probablemente expiotaron y que 
reciben el nombre de 

..... Cx^wcio -evi 

a. satelites. ^ 

b. asterdides. c^p* • ^7 

c. gaiaxlas. 

(Mi) 12. Ei planeta m^s pequefio de nuestro sistema solar es 

a. Mercurio. 

b. Plutdn. C\«v\c\ft^ ^vi 

c. Urano. P 
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j;^%ALUAC!ON DE UNIDADES DE CIENCIA (EL SISTEAAA 
SOLAR, LAATMOSFERA, ELTIEMPO) 



IMombre Fecha 



Escuela Grado 



$elecci6n MCiltiple (ctda) 

^3) 13. El planeta mi% cercano a la Tierra es C\c?v\c\tv. 

a. Jupiter. ^sp.- p. 

b. Marte. ' * ^ 
c Venus. 

fezj 14 El planeta que presenta m^s similaridad con la Tierra y que 
sugiere la posibilidad de vida en 6\ es 

a. Marte. C\^v%cvec .pvi 

c. Mercuno. • n ^ 

(l 7) 13. El m^s lejanode losplanetas es 

a. P!ut6n. C^ev^c^ <?vt 

b. Neptuno. ^sp- p ji 

c. Saturno. • ' 



(ll) 16. El nombre del primer sat^lite artificial es 

a. Gemini. C \Jt\^c^ic^^ (P^^ 

b. Apolo. 

c. Sputnik. 



17' Cuando la Luna tiene su fase iluminada al lado opuesto de 
la Tierra y no podemos veria, decimos que est^ en 

a. cuarto menguante. 

b. luna nueva. C\€%\c\«^^w 

c. luna I lend. ^ 
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tVALUAClON Dt UNIDADhb Ut CItNCIA ( tL bIblhMA 
m SOLAR, LAATMOSFERA, ELTIEAAPO) 



Nombre 



Escuela 




iag) 20. 



Fecha 



Grado 



18. En el siglo XVII Galileo inventd 



a. la mdquina fotogr^ica. 

b. el sistema de radar. 

c. el telescopio. 



P- 3 



La fuerza gravitacional del sol es 28 veces mayor que la de 
la Yierra. Un astronauta pesarfa all^ 

a. mds que en la Tierra. Ctewcic^ 

b. menos que en la Tierra. ^S(* • P 3 

c. lo mismo que en la Tierra. 

El instrumento que se utiliza para medir la presidn del 
aire se llama 

a. termdmetro. C^Vi^o^, 

b. bardmetro. ^ 

c. velocrmetro. c4^p* p. 
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EVALU AC I ON DE UN I DADES DE C I ENC i A (EL S I STEMA 
m W H''^^^'^^'^ ^ ATMOSFERA. EL TIEMPO) 

Nombre Fecha 



Escueia Grado 



Ciertoofalso 

Escribe en el espacio en bianco la letra "C" si la oracidn es cierta o "F" si 
es falsa: 

^kr^Ak CovrecJr 

(35) 1. Las mareas m^s aitas ocurren cuando el sol y la luna est^n 
en Imea recta con respecto a la tierra. 

(60^ 2. La teorra heliocfintrica sostiene que la tierra es el centro del 
sistema planetario. Cimc^i. «vt f , p.3L 

3. Entre la tierra y la luna hay siempre una distancia de 252, 710 mi I las. 

4 El mes sideral tarda 27 1/3 dfas. , r i • ' 

5. Las cuatro estaciones son producidas per el movimiento de 
trans lacidn de la tierra. CieVe-iA ^^^^ i3 

6. El didxido de carbono es esencial para el proceso de fotosfntesis. 
(^^77) 7. Los tornados son tormentas que se forman unicamente en el agua. 
(^/) 8. La carretilla de mano es una paianca de segunda clase. 

La polea es una modificacidn de la rueda. 
(^^^ 10. El trabajo se mide unicamente en tdrminos de fuerza. 
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EVUALACION DEUNIDADES DE CIENCIA (EL SISTEMA 
^t^U^WSJ'^* SOLAR, LAATMOSFERA, ELTIEMPO) 

Nombre ?ech^ 



Escuela Grado_ 



CiertooFalso 



Escribe en el espacio en bianco la letra "C" si la oraci6n es cierta o "F" si 
es falsa: 

Q^) i. La iuna es una estreila porque tiene luz propia. Ciei^K^iA 

(a^\ z En 1957, los rusos lanzaron a! espacio el primer satellte artificiaL 

^^l^ 3. El movimiento de la Iuna alrededor de la tierra se conoce como 
rotacidn. C^^^c^K P^p. pg 

(fcg) 4 Saturno es el planeta mis grande del sistema solar. 

(^\) 5. Los cambios metereoldgicos como lluvra o nieve ocurren en 
la capa exosfirlca. C\^^^ tv* Fs> fa. p 

(it^) 6. Los cirros son nubes formadas por crista les de hieia 

/ fg\ 7. El lugar donde se appya una palanca se llama fulcro. 

8. El clavo es un ejempio del piano inclinado. 

//^J 9. La friccifin es una fuerza que ayu& a los cuerpos a permanecer 

en movimiento. lAo^. £itfv\(d< : Sfi^ Qui^At^ ft^leov, p.^ 

^Jjt^ 10. Si una persona empuja un edificio ha efectuado trabajo. 
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STUDY 4 

PRINCIPALS' PERCEPTIONS OF MODEL B 



As was stated in the general process evaluation (Study 1) , 
impletoentation of the MODEL B cos^Kpnant has been tnost difficult. In 
order to try to gain insights from the problems of this programi which 
might be loseful in the event that similar programs were initiated at 
other schools^ the evaluators interviewd the principals who had had 
the MODEL B component in their schools. 



Procedure 

Subjects 

All four principals were interviewed. The principal of 
McKinley School had had a program during 1970-1971, The principal of 
Bethione School had had an operational program from September 1970 until 
June 1972, The other two principals had programs which were operational 
in their schools from September 1970 to the present (3 years); these 
programs were expected to continue in operation during 1973-1974, 



Instrument and Procedure 

The senior researcher of the project's evaluation team visited 
the schools during early June 1973. Interview structure had been worked 
out to assure that the relevant issues would be discussed and to provide 
a uniform format for recording the interview results. This is shown in 
Appendix 4.1. Immediately after each interview, the principal's reactions 
were recorded on the form. 



Analysi s 

As there were only four principals, it was feasible to rearrange 
the reactions of the principals by content aurea and prepare the narrative 
which follows. 



Results 



Schools with Operational Pro^rrams 

Principals of both elementary schools with operational MODEL B 
programs felt that after a few years of instruction, Spanish-dominant 
pupils who can handle English sufficiently well should be funneled into 
mainly English instruction. Both agreed that for pupils who begin first- 
grade instruction in MOPEL B, this funneling should come after the third 
grade. Both principals felt, however, that Spanish-speaking pupils should 
continue to receive some instruction in their TOther tongue (one hour per 



tftVH ^^^^ 

day in Miller^ one-half hour per day in Ludlow). They felt that, apart 
from this minimal contact for Spanish-speaking pupils able to learn in 
English, Spanish instruction should be given only pupils having diffi- 
culty with English. 

In other areas, the principals of schools with the two operating 
MODEL B programs differed in their perceptions. The most telling area of 
difference involved English-speaking pupils. As was noted earlier in this 
report, neither of the MODEL B schools had classes of English-dominant 
pupils coupled with the Spanish-dominant ones as had been the original 
intent of the MODEL B design. At Ludlow, the principal indicated he felt 
that the performance of most English-dominant children in his school was 
too low to have them spend time learning a second leuiguage. In contrast, 
at Miller, the principal stated that the lack of participation by English 
dominants was a result of his misunderstanding of program goals at the 
time that he became principal. He stated that, next year^ teauaing of 
Anglo and Latino classes would be reinstated as it had been in 1971-1972^ 
He stated that he thought that only selected, talented, English-dominant 
children should be enrolled in Spanish-as-a-second-language instruction. 
(A few such pupils have received informal SSL instruction in this manner 
during 1972-1973, but they have not been considered a part of the LET'S 
BE AMIGOS program and have not had opportunities to mix with the Spanish-^ 
speaking children.) 

The two principals also differed in their perception of the 
services that the project is providing to teachers • The Ludlow principal 
felt that his contacts with the project director have in^roved super- 
vision, staffing, and materials to the point where there is no serious 
problem. The principal at Miller^ on the other hand, felt that too much 
of the monitoring involved observing for the purpose of evaluation but 
there was insufficient feedback to teachers regarding the problems that 
had been observed. He also felt that there was a need for more materials. 
He said that teachers felt that the Miami Materials Package (developed by 
the Spamish Curriculiam Development Center) was inadequate, and that •re 
ESL materials were needed. 

In suiranary, the reactions of the two principals with operating 
MODEL B programs in their schools reflected a low commitment to bilingual- 
ism per sei both preferred to think of their progriua primarily as a com- 
pensatory one for short-term instruction. This was in marked contrast to 
the intentions of program planners who said that they wished to foster 
bilingualism as an end in itself and felt that students shouJ[.d have con- 
tinuous expos vire to two languages, on other issues, the principals' 
views were contrasting, one fee .ling that the program could be extended to 
English-dominant pupils, but also feeling that there were problems in 
management, and the other feeling that the program should serve only 
Spanish-dominant children, but feeling that most management problems had 
been handled satisfactorily. 



Schools without Operational Programs 

The two schools whose programs have been withdrawn were very 




1 



m ^^^^^ 

different from each other. The principal of the McKinley School stated 
that there were several problems which prevented the program from operat- 
ing successfully. He said that programs needed to be tailor-made for 
each school and that the development of a single program to be used at 
many sites was a waste of time. He felt that English as a second language 
was the only desirable program, the one which met both his and his commu- 
nity's needs. He also said that the project directors prevented the pro- 
gram from operating successfully because the program divided the control 
of teachers (between the principal and the program management) when the 
teachers should be primarily under the control of the principal. 

The Bilingual Program heis ceased to operate at the McKinley 
School but an ESL program continues to serve some Spanish-dominant 
students. 

In contrast, the demise of the progreun at Bethune School was 
the result of failure of the Spanish-speaking population to grow as 
anticipated. The principal stated that in the year the program was begun, 
a large number of Spanish-dominant pupils entered the school in the elem- 
entari'^ grades. In subsequent years, the number of pupils has not con- 
tinued to grow sufficiently, so that a major bilingual program has not 
been needed. She stated that she was satisfied with the operation of 
the program when it was in the school, offered no specific criticisms, 
and said that she would want a similar program if the need arose. The 
Bethune principal said also that the teacher assigned to her school during 
the program was still working with a mixed class, which includes the 
Spanish-dominant and some English-dominant pupils. He includes ESL and 
SSL in the instructional program, and makes some use of Spanish in the 
classroom. 

Taken together, the results show a marked contrast between the 
two schools which have now discontinued MODEL B conponents. In one 
school, where there was sharp objection to the emphasis on Spanish, the 
bilingual elements have disappeared, leaving only ESL. In the other 
school, some program elements have been maintained, even though there is 
no formal program. 



Evaluators * Comment 

With the exception of one school in which the Spanish- speaking 
population did not grow as euiticipated, the results of these discussions 
wii-h the principals suggest that in the Philadelphia schools the princi- 
pals' attitudes and expectations for programs are at least as in^rtant 
as the need in the community. It would appear that the idea of studying 
in a language other than English as a worthwhile goal in itself is not 
yet accepted among these principals, except where it is needed to meet 
specific needs of recent inmigrcuits. 

In replicating this program, or in extending the program to 
new sites, resources should be allocated to assure that principals have 
a clear \inderstanding of the program and its adms, and agree at least to 
experiment with a program en5>hasizing bilingualism as a desired outcome. 
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SAMPLE OF THE STRUCTURED INTERVIEW USED 
WITH TKS PRINCIPALS OF "MODEL B" 
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School and Principal 



Structured Interview of Principals 
la Model B 



1. Aak Principal to asseaa the program (3) operating in his school. 



Probe for (a) Coramitmant to bilingualiam 



for Anglo3_ 
for Latinos 



2. Ask principal to describe the ideal bilingual program for his school. 



(a) Parts of the principal's program which are feasible for 
short term 



(b) Discrepancies bttween the principalis ideal and the prog -^m 
in operation 



3. What were the program strengths and its main problems this year or its 
last operational yearv 



Probe about (a) Supervision 



^b) Staffing and personnel 



(c) Materials and support services 



(d) Program content and procedure 



(e) Other 



4. What kinds of changes need to be made next year? 
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study 5 

KINDERGARTEN AND PREKINDERGART^N PUPIL PERFORMANCE IN MODEL A 



During the first yeara of the r^ET^S BE AMIGOS program kindergarten 
pupils were examined with the Philadelphia Readiness Test, a locally de- 
veloped instrument which had been used extensively in the schools to measure 
number and reading readiness. For use in the LET'S BE AMIGOS program, 
special Spanish instructiora were developed. When pupils were tested on 
this instrument it was found that, in two of the project's first three 
years, pupils of both language groups exceeded citywide and earlier 
Potter-Thomas School performance, and in one year, results were close to 
or above citywide performance although below the performance of the local 
Potter-Thomas base line. These base lines were all derived from the 1968 
testing, the last citywide administration cf the test (See Study 7 Offenberg 
1973) . 



The prekindergarten pupils have also been tested in the past. The 
instrument used consisted of a selection of items from the Philadelphia 
Readiness Test and some new material derived from prekindergarten objectives 
Spanish and English instructions ware prepared for this test. This test 
was used to rank pupils in terms of their achievement <n prekindergarten, 
so these with the most skill could enter an enriched all-day kindergarten 
prograun. 

This study is a partial replication of the work done In the kinder 
gar ten assessment as well as tryout of the Boehm Test of Basic Concepts , 
a published instrument designed to assess a number of basic concepts which 
were related to stated prekindergarten and Kindergarten objectives. 

In the kindergarten, pupils were given both the Boehm and the 
Philadelphia Readiness Test. This permitted (a) comparison of pupils with 
previous base lines and (b) the computation of a regraasion line between 
the Boehm and the Philadelphia Readiness Teat, so that program objectives 
could be restated in terms of the Boehm. 



Part 1 of the Boehm was also used to assess children in the pre- 
kindergarten in order to determine which should go to the all-day kinder- 
garten program. This change w&a made after program supervisors agreed 
that a high score on the Boehm Part 1 was well enough related to program 
content to be used in this way. 

An attempt was also planned to tease out whether the Bilingual 
Program's all-day kindergarten component was enchancing pupil performance 
at levels beyond that which could be predicted from earlier prekindergcirten 
testing, but preliminary examination of the number of pupils with regular 
kindergarten experience who had been in prekindergarten was too low to 
conduct a meaninc'al 2malysia (9 pupils) . 
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In this study only on« stattd obj«ctiv« was involved, that 
applying to Philadelphia Raadlneis Tast parfomano* ot tha klndaroartan 

pupils . ^ 

Objective 

Kindercyarten. Objective 2.7 of the 1969-1970 propoaal stated 
that kindergarten pupils would exceed the citywide mean of 20.1 on the 
Philadelphia Readiness Test. 



Procedures 

Program 

. ^ Teaching, during 90% of the instructional time in prekindergarten 
and kindergarten, was in the pupils' mother tongue. Both the Boohm test 
and the Philadelphia Readiness Test were therefore adminla tared in tha mother 
tongue of each pupil taking the teat. "^'wiot 

The micro-objectives of the instructional program of both the 
prekindergarten and kindergarten components guided the teachers in teaching 
^'■"'fC *l!??f'.^f^^f''' *^ "'^•'^ concepts direcUy related to items appaarlng 
^^.r^"^^"^*^^^^^^* Reidiness Test, in general, teachers were proviSS 
with the mxcro-^jectlve lists, but were not obligated to follow specific 
instructional procedures. Teachera and supervisora worked out instructional 
activities which they felt would lead to mastery of concapta which appeared 
in the lists. The prekindergarten and regular kir*dergartens mat for one- 
half day. 

In addition to these activities, reading in the oupila' a»ther 
tongue was introduced in the all-day kindergarten, a program attended 
primarily by the most able of the previous year's prekindergarten pupils. 
This class met for the full school day. 

The relationship between progr&m content and items on the Boehm was 
more tenuous. The manual for tha test (Boehm, 1970) says that items measure 
M^^'^w^. V""^ quantity, and some unclassifiable ones as 

•Touch," "Soft," "Other," and "Without", which are also similar to content 
of the program. However, there is no direct correspondence between teat 
items and program content. 

Evaluation 

instruments . The Philadelphia Readiness -est and its Znglish and 
Spanish instructions have been described in previous reports of the LBT'S 
BE AMIGOS PROGRAM. (See O*fenbor(^, 1972, Study 7) . The teat requires that 
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pupils copy shapes, match words and letters, and perform simple coxinting and 
numerical operations. While there is not an exact correspondence between 
program content and the test, most teat items are similau: to, or extensions 
of, micro-objective3 specified for the kindergarten level of the Model School 
programs * 

The Boehm Test of Basic Concepts (srac) is designed to measure 
children's mastery of concepts necessary for achievement in the first years 
of school. The test is read aloud by the teacher, and is appropriate for 
use with children in three grades — kindergarten, 1 and 2. BTBC results 
may be used to identify children with deficiencies in these areas and to 
identify individual concepts in which the pupils could profit from instruction. 

The test consists of two parts designed for consecutive administrations, 
with the items arranged in order of increeising difficulty. This permits 
use of Part 1 of the instriament to assess skills of the younger, prekindergarten 
rliildren. The instructions are available in both Spanish and English versions. 
The standardization process was carried out on the English version, but the 
publisher claims that tentative work with the Spanish version suggests that 
the norms for Spanish-speaking children should be about the same as those for 
English-speaking children. 

Adminis tza t ion . The Philadelphia Readiness Test was administered to 
kindergartens by the regulau: classroom teachers. Pupils received instructions 
in their mother tongue. As was the case in the past, teachers administered 
thvA tests in small groups, one page of items at a time. 

The Boehm test was administered individually by the program supervisor 
to the prekindergarten pupils (Part 1 only) and to the all-day kindergarten 
pupils. The Spanish-speaking pupils in the regular kindergarten classes took 
their tests in small groups while the English-speaking pupils from the same 
classes took their tests individually. The merj ers of the research staff who 
did the majority of the testing in these classes selected group rather than 
individual testing on the grounds of personal preference and comfort with 
the testing situation. The test publisher suggests that either approach 
should provide similar results as long as the numbers of pupils tested in 
groups were small enough to give pupils individualized attention. 

On the kindergarten level where both Parts 1 and 2 were given, 
testing usually took place during two sessions several days apart. Occasionally 
when a child seemed energetic and enthusiastic after Part 1 and he wanted 
to continue immediately with Part 2 he was allowed to do so. Testing took 
place during May and June, 

Subjects . All pupils in the kindergarten and prekindergarten 
programs were tested unless they were absent for extended periods of time. 
In the kindergarten 157 (69%) of the pupils took both tests, and 32 (14%) 
of the pupils took one or the other of them. In the prekindergarten 79 
(88%) took the Boehm. 

Analysis > As the prekindergarten test administration was primarily 
designed to rank pupils in teinos of their readiness for the all-day kinder- 
garten, descriptive statistics were obtained for the part of the Boehm that 
was applied to this group. 



In addition to descriptive statistics, performance of kindergarten 
pupils on the Boehm Test were compared with the norms for low-socioeconomic- 
status pupils. Descriptive statistics were also prepared for the Philadelphia 
Readiness Test. The means obtained were compared with those of the criterion. 

In addition, to restate objectives (now in t'^rms of the Philadelphia 
Readiness Test) in terms ->f the Boehm, a linear regresi>ion equation and correlation 
coefficient were computed, equation is for predicting Boehm scores from 

Philadelphia Readiness Test scores. The correlation coefficient shows the 
amount of variance that the two tests have in common. 



Results 

Kindergarten Testing, Philadelphia Readiness Test 

Results obtained in the 1973 testing of the kindergarten pupils 
ax'e in Table 5.1. The mean scores of 22.4 (English-dominant) and 22.6 
(Spanish-dominant) show performance very similar (within 0.6 correct items) 
to that obtained last year, and about one and one-half items more than 
necessary to meet the objectives. Scores of both groups exceeded those of 
the base line. As expected, the performance of the all-day kindergarten 
group exceeded that of the total kindergarten. The 17 English-dominant 
pupils had an averaae of 24.1 and the 18 Spanish-dominant children in this 
group averaged 25.4 (test maximum is 27). 



TABLE 5.1. KINDERGARTEN PUPIL PERFORMANCE ON THE PHILADELPHIA READINESS TEST 



Item 



Pre-program (1968) Base Lines 



Model a (1973) 



Mean of 
Group 



All Potter- 
Philadelphia Thomas 



10.1 



20.9 



English 
Dominant 



22.4 



Spanish 
Etominant 



22.6 



Standard 
Deviation 



5-3 



5.9 



No* of Children 



95 



95 



Kindergarten Testing, Boehm Test 

Results of the Boehm test administration are shown in Table 5.2* The 
results obtained weaP4i fli«i>lriar to those on the Philadelphia Readiness Test, 
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witli both groups at about or above tho 50th percentile for pupils of thoir 
socieconomic status. Results for the all-day kindergarten subgrouo showod 
a high level of performance. Nineteen Spanish-dominant pupils averaged 
34.0, (75th percentile) and 18 English-dominant pupils, 32.0 (7Cth perccntiio) , 
a result which shows equally superior performance by both groups. 

TABLE 5.2. KINDERGARTEN PL't^-L PERFORMANCE ON BOEHM TEST 





Item 


Encfli 


rh-Doirinant 


Spanish-Dominant 


Number Tested 




87 


75 


Mean Score 




30,6 


28.2 


Stcwndard Deviation 




6.39 


6.03 


Percentile Rank of Pupil 
(Low SJ:.S. norms for 
midyear kindergarten) 


at Mean 


65th 


50 th 



Examination of the regression of the Boehm upon the Philadelphia 
Readiness Test (PRT) showed a moderate correlation of .40 (df=153, p=.01) . 
The regression equation for predicting Boehm scores from PRT scores is 

A 

Y = 13.2 + .70X 

(Boehra) (PRT) 

These results were obtained for both ethnic groups combined. On the basis 
of thesf results the equivalent of the 'itywide 1968 mean on the Philadelphia 
Readiness Test is 27.3, and that of Potter-Thomas in 1968, 27.8. 

Prekindorgarten Pupils' Performance on the Boehm 

The testing of prekindergarten pupils on the first half of the Boehm 
was designed to answer the question, "Does the difficulty range of Part 1 
of the test seem to be appropriate for assigning prekindergartenars to regular 
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and all-day kindergarten? The results shown on Table 5.3 indicate that 
the difficulty range is probably satisfactory, with the average child 
having a mean f;core of about 60% of the items. There appeared to be little 
or no meaningful difference between the two language groups on this half 
of the test when administered to prekindergarteners . 



TABLE 5.3. PREKIND^P^'^RTEN PUPIL PERFORMANCE ON BOEHM TEST, PART 1 



Item 


Encl i s h- Dominant 


Spanish- Dominant 


Number Tested 


45 


34 


Mean Score 


15.0 


15.7 


Standard Deviation 


4.6 


4.1 


Percentage of Items Correct 


60% 


63% 



Evaluators * CoraTiCnts 

Results of this study were* on the whole, gratifying • It was 
good to see that pupil performance on the Philadelphia Readiness Test 
was maintained at a level beyond the minimxam stated by the objective 
despite the interferences which occurred during the school year. It 
was also pleasing to see that both ethnic subgroups of the reaular kindergarten 
and all-day kindergarten had achieved well in comparison with other 
children of similar socioeconomic status. The small difference in overall 
performance of the English- and Spanish--dominant kindergarten groups as 
wholes on the Boehm test could possibly be explained by several factors. 
Although the publishers of the test maintain that testing can be done 
either individually or in small groups without affecting performance, the 
different grouping in which Anglo and Latino pupils in ti regular 
kindergarten took their tests seems a likely cause of the discrepancy, which 
was observed only in those classes where the testing situation was different 
for the two groups. Another factor which might have influenced the scores 
of regular kindergarten classes was a possible difference in the amount 
of interaction between items on the Boehm test and the program content 
in the Spanish versus English regular kindergarten classes. Possible 
deficiencies in the translation of the test might also have presented more 
of a problem to the pupils in the regular kinderga^'ten than to the pupils 
in tile more select all-day kindergarten. 

To begin to answer these questions, attached to this paper are 
two appendices. Appendix 5*1 shows the percentage by ethnic group and 
grade, of pupils who succeeded in completing each item* Appendix 5.2 
contains a review of the Spanish translation of the items by a native 
Spanisn speaker which might point to defects in the preparation of this 
version of the test. 
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APPENDIX 5.1. PERCENTAGE OP PUPILS SUCCEEDING ON EACH ITEM ON THE BOEHM 





Item 




L fop 




1 s 






s 






s 


Next fo 




s 


5. iniido 




s 


6. Some, nof 
many | 




9 


7. Middle 1 




s 



Pr€ikin<i«jrg»rton Reg. Kindergarten All-Day Klnderqnrton 

Enq.-Doa. Sp.-Dom. Fm.-Dom. Sp.-Dom. Knc^.-nom. Sp,-L)f>re. 
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Appendix 5.1. (continutd) 



i 



Item 









2'. Aimony 




P 


28. Sidi 




s 


29. 8«9inmn9 




T 






M 


31. 




M 


32- Nof fTptf 




Q 


33. N«v«r 




T 



34. Mow 

35. Motdiai 



36. Always 



'5 oin T 



37, Medium* 
«it«d 




1 


33. Ri'gh* 




s 




39. forword 




s 


<0. Z«ro 




9 


41. Abov« 1 




S 


42. Every ; 




Q 



43. Stporoftd 



44. Lan 



.1 /I 



45. Poir 



46. Slip 



47. Equol 



40. In ordfif 



49. Third 



R«9* Klnderrrarter 



Knq,-Dom, Sp, -pom 




50. 



mi 
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APPENDIX 5.2. A NATIVE SPANISH SPEAKER'S REVIEW OF THE SPANISH VERSION 

OF THE BOSHM 

Miss Leonor Lega, a native Spanish speaker (from Colonfcia) 
reviewed the Spanish version of the Boc?hm. she made tha following 
comments . 

"In Latin America there are regionaliams which cause worda or 
phrases which are used in cna country to be awkard or misleading in other 
countries . At least two obvious examples of this problem (appear on the 
teat. In a sample item the word platano is used for banana , whereas In 
roost of South America guineo is used. In these areas, platteo is a vegetable 
related to the banema, but served fried. " ' ' 

"The phrase en el mismo medio de is used for ricdit on the... In 
the teat. In Puerto Rican speech, exactamente en v*ould be clearer. 

"Both of these instances appear in the instructions and samples 
of the test and may have caused some pupils confusion in deciding exactly 
what was to be done. 

"Both regionalisms noted seem to reflect the pattern of Mexican 
speech, careful review may show that other items have regionalisms 
characteristic of that country. 

"At lea?t one item is poorly translated (No.30) . The English 
version depends on the use of forms of the word other and _another ; Ona 
is an ice-cream, ano ther is a piece of pie. Mark the other^ f'l ."aV. the" 
third) dessert. The Spanish version uses otro for both other and another, 
possibly leading the pupil to believe that he is being aSwTto m ark tiie 
pie . " 
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STUDY 6 



STANDARDIZED TESTING OP SECCJND-OHRaJGH FOURTH-GRADE PUPILS 
IN THEIR FIRST AlC SECOND LANGUAGE 

T^l T>H"'^^^ — — ^^^^^^^^^ 

grade pupils u> mcdel B) and arribr third- and fourt),-gr.drp^pi£ 

.-v <: In the thlra-ysar evaluation report (offsnberg et al. 19731 

"'""^ standardised testing .."U'^ti^'llL 

were T^l'^^^^^l'llT^^Tl ^ ZV^Hn^r ^ 

the p.e-p.U'r :is;e%^H:i:diiais^^^^^ 

third-grade Spanish-dominant children shouArt 
1'^°"^" ' P«-P'S9r". base line in reading IpS^sSTm m«sured 
S ^ %tTMc:."°'""' • SpanLh^^eadiig" rt'u«r 

«f ?I ^ird-grade Latino pupils, who had receivad about ona vear 

grade a^ivalenf ranging fr» 1.6 (word-.tudy sUlL,*' f^S",|^mngfr 

ootcon**' Engliah-doailnMt ouplla were oomoared 

Se oa^f i:ir^s:;rs/"'"'' ^ *^ pott, r.T?oL. s*"i k 

the last year that the program featured regular, nonbilingual instruction 

^„T!! w ' **"in9 program conducted in 1968, in whl^au 

Spanish-speaking pupils were tested in reading in their mother t^n^. 

..™ ^ 1972-1973 school year the testing which led to the 

above results was replicated, m addition, pupils in the fourth araS 
were tested. EnglishMjomlnant pupils were t^sLd usLfL^Tortte 
lowa jests of Basic Skills, M Spanish-lominant pupl]^ tfstfd^ith 

^^^I^ideufS."" - - 

Pourth-grada pupile in MODEL A ARRIBA were also oiven 
teats «„»eiiy used in the second or third grade with ^tj^^ s^Zrs 
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their second language. Thus, the English-doninant pupils were tested 
^^^^ ^® Itest de Dest rezas Basicas , and the Spanish-dominant second 
graders were tested with the Stanford Primary Battery ii . Program 
planners- pupil-performance expectation, in Second llnguage were clearly 
stated for model a and MODEL B Spaniah^omin^nt children: third-grade 
pupils should be about 1.8, and fourth-grade pupils should be about 2.8 
on norms for native English-speaking pupils, ihare were no clear ex- 
pectations for the English-dominant group. 

program, pupils were generally recent migrants. 
It was therefore felt that testing in Spanish was appropriate for this 
group, but testing in English might not be. After considerable discus- 
sion, it was decided that pupils in the ARRIBA third and fourth grades 
would be tested in English as well as Spanish, more to obtain an idea of 
where pupils were than to assess the program. 



Procedure 

Program 

MODEL A instruction was provided by teams of two teachers, one 
English-dominant and one Spanish-dominant. At the lowest grade levels 
both teachers in the team knew English and Spanish, m the upper grades 
some of the English-dominant teachers did not speak Spanish, while in 
theory teams taught one grade level (or had a mixed class of one or two 
grade levels, pupils went to instructional groups consisting of pupils 
who were at approximately the same instructional levels rather than being 
kept with students in the same grade level. Pupils in the program re- 
ceived instruction primarily in their mother tongue with only about 10% 

f^f "^.l*"5uage. in the upper grades (3rd and 4th), instruction 
was half a day in each language. 

in MODEL B, instruction was given in grade-level classes. All 
pupils involved were Spanish-dominant and teaching teams included Spanish- 
dominant and English-dominant teachers, otherwise, it paralleled Model A. 

K . ARRIBA third and fourth grades, instruction was provided 

by two .eachers, one English-dominant and one Spanish-dominant. Because 
the program is designed for pupils newly arrived from Spanish-speakina 
areas, about 4/5 of the day's instruction was in Spanish (Spani^ as a 
first language, science, social studies, and mathematics). The Spanish 
instruction paralleled the regular Philadelphia curriculum in these sub- 
ject areas as closely as possible, m addition all pupils received 
English-as-a-second-language instruction which began primarily with oral 
work, but gradually introduced reading in English as well. 

o , ""^^ Laiaiaw Reading Series was used for Spanish instruction, 
the Bank street Readers were used for English instruction in Reading 
Levels 1 to 3, the Lippincott Readers were used for Level 4 and above 
in English. 
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EvaluatlcKi 

During May and JXine, standardized tests were administered to 
the pupils of the program, in MODEL A tests in the pupils' mother tongues 
were administered by classroom teachers. During the first- language test- 
ing, members pf the research st^iff walked from room to rooc. to assure that 
teachers administered the tests according to published instructions 
Second-language testing was administered to pupils in the auditorium, a 
room which has provision for writing. There, all pupils taking a test 
were tested at once. 

Testing in both languages was conducted in several sessions of 
one hour or less to assure that students were not overtired by the pro- 
cediires . j f 

In MCOEL B -n*? ARRIBA, tests were administered in the classroom 
by the teachers, m virtually all the testing sessions a member of the 
evaluation staff was present to monitor and to assist the teachers. 

Instriiments . The tests used were as follows: 

.Stanford Achievement Test , primary Battery ii - four subtests 
word Meaning, Paragraph Meaning, Spelling, and Word-Study Skills. This 
test was administered to English-dominant second graders and to third- 
and fourth-grade Spanish-dominant children. 

. Iowa Tests of Basic Skills , Level A was administered to third- 
grade English-dominant n,miis. Level B to fourth-grade English-dominant 
pupils. 

. Test de Destrezas Basicas en Lectura (test of Basic Reading 
Skills) . This was administered to Spanish-dominant second- and third- 
grade pupils, and to fourth-grade English-dominant pupils. 

.Prueba de Lectura (Reading Test). This was administ red to 
fourth-grade Spanish-dominant pupils. 

All testing in the mother tongues was done with instruments 
prescribed for the pupils' actual grade level, ifests used for second 
language were for levels of one to two years younger than the pupils ex- 
amined with them. 

In administering the tests to pupils in their first language, 
publishers' directions were followed explicitly, m the second language, 
instructions were translated into the pupil's mother tongue after first 
being read in the target language of the test. 

Subjects. Due to pressures resulting from the school stri'ir 
and the need to give both a f.-ijrat- language and a second-language battery 
to many pupils, makeup taats could not be provided. As a result, numbers 
of tests administered were frequently lower than the number on roll. This 
was especially « problem among pupils who took the Iowa Test. Administra- 
tion took several days, and the data analysis program dropped all pupils 
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who had missed any test part, in addition, Spanish-language testing was 
confined to pupils who had enrolled in ths Bilingual Program in or be- 
fore September 1972. Hie following list indicates the number of pupils 
on roll in April 1973: 

.MQDEIi A: 248 second grade, 116 third grade, 192 fourch grade. 
.MODEL B: 51 second grade, 40 third grade. 
•ARRIBA: 15 third grade, 25 fourth grade. 



Analysis 

Results of testing pupils in their mother tongue were compared 
with historical base lines. The Spanish-language base lines were from 
the April-May 1968 testing of Spanish-speaking pupils in the city of 
Philadelphia. English-language performance was compared with performance 
of Engliah-dominant pupils at the Potter-Thomas School the last time the 
tests were given before the Bilingual Program was instituted in the grade: 
1970 for the second grade, 1971 for the third grade, 1972 for the fourth 
grade. During 1971 and 1972 pupils in the base line groups were all 
participating in a special reading program being carried out in the entire 
"District 5" area in which the Potter-iaiomas school is located and thus 
may have scores that have been elevnted by this districtwide program. 

In the base line group, some fourth-grade pupils were tested out 
of level (i.e., they took lo\-i& test Level A). As a result, grade- 
equivalent scores were used in the Iowa test analyses. 

Analysis of variance or multivariate analysis of variance (when 
subtests were analyzed) were used to compare pupils in the program with 
the base line groups. These analyses were of the grade equivalents (for 
the Iowa tests) or raw scores (all other tests). 

in second language, where no base line was available, descrip- 
tive statistics (mean, standard deviation, percentile rank of the nean, 
etc.) were provided. Descriptive statistics were also provided for the 
tests of performance in the ARRIBA program because there was no appro- 
priate base J.ine group with which these pupils could be compared. 

In addition to these analyses an attempt was made to see if 
fourth-grade MODEL A pupil performance in the second language was de- 
pendent upon length of experience in the program. English-dominant 
pupils' scores were correlated with the length of time that the pupils had 
I «en in the program (one, two, or three or more years). 

The situation was more complex for Spanish-dominant pupils be- 
cause of the importance of the use of the language in the home. As a 
result, partial correlation was used in which the effect of length of 
experience in the program was observed when family language (Spanish 
only or bilingual) and birthplace (Spanish-speaking area or mainland of 
the Lnited States) were partialed out. 
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Haaulta 



Spaniah-Sj^aking Pupila— Motrhay 



196 8-b.,o line. ;f ^ ^'^'^ ^ preprogram 

MODEL A and MODEL B, in^botil^a af^lj^ ^ ^ 

60th and 65th perceAtSee! ^ ^^^•'^ the 

ni^^fS^S*^ ^ SPAMSH-OOMIIJANT PUPILS 

ON THE TEST DE DES1RE2AS BASICAS EN LECTORA 



Item 
Second Grade 1 
Mean Score 
Percentlla Rank* 
Standard Deviation 
IIuiBbM: of pupila 
oaiird Grade i 
Msan Score 
Percentile Rank* 
Standard Deviation 
Wunber of Pupila 



Model A 


Model B 


1968 Baae Lina 


79.7** 


80.2** 


60.8 


60.0 


62.0 


35.0 


26.7 


18.1 

• 


16.2 


81.0 


25.0 


366.0 


95.0** 


93.1** 


70,2 


65.0 


60,0 


27.0 


19.7 


18.6 


26.7 


72.0 


27.0 


— 366.0 



Anaxyaia of Variance 





MS 


P 


df 




Program Tteatment 


36608.4 


118.7 


2 


.001 


Grada 


26235.4 


85^1 


1 


.001 


Interaction 


584.1 


1.9 


2 


NS 


Within calla 


308.4 




932 





^- 

v_ 



\ 
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This compared with performance at the 35th and 27th percentiles 
3toJ?ican;'di?r ^^y-^ variance showed a cSa'cut'"' 

aiSfh,^!^^ groups, a difference which was obviously 

attributable to the superiority of performance of pupils in boS a 
and MODEL B when compared with the ^se line groupS? s^rictJy^pTSSa 
further anal.r^is would normally be required to -hS thaftSe di?Sre^^' 
between groups was attril>utable to the differences b^eef^he S^JJ^e 
and the other groups. However, the mean differences were so clearlcut 
as to make further analysis appear redundant. 

At one ARRIBA school, Wariny, a few third-grade students were 

10 Pupila Who completed the Test Se D::Sezas 
Basicas had an average score of 96.0 (standard deviation was 15 7) 
percentile score of thib average was 65. ^^-^^oi^ 15.7). The 



Prueba De Lecture 



with the l^f "S^'^'' ^^^^^-^^^^^t pupils was ccmpared 

witn tne 1968 base line. The results, in Table 6.2, showed that Vh^ r.^r^ 
gram had substantially improved pupil performance. 

Table 6.2. PERFORMANCE OP SPANISH-DOMINANT FOURTH-GRADE PUPlIfi 
(IN MODEL A) ON THE PRUEBA DE LECTURA 



1968 Base Line 

Mean Score 17.7 
Percentile Rank 5,0 
Standard Oeviation 8.7 
Number of pupils 180.0 



Model A 



31.3* 
40.0 
23.3 
74.0 



Analysis of variance 



MS df p 



P 



Program 9686,7 1 

252 



45.8 ,001 



Within Groups 211.0 

*°^dfg"ef'''^"" "^"^ ^^"^ * statistically significant (p<.001) 
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MODEL A pupils were at the 40tli percentile as compared to the 5th- per- 
centile performance of the base line group. 

In addition to the MODEl. A group, 15 pupils in the ARRIBA 
proqram (4t.h qrade) completed the Prueba de r.e(-tura > Thv mean Bcnre tor 
tht^Ht* pupila was 13.f>, equivalent to a •core at the* rmirth rrcMii ilo. 
•rtio utandani deviation was vary large, 11.1 (Lho ciistrliniLlon oJ Hvorvu 
was Bkewfid: the highest raw score was 45 1 the lowest was zero). 

English-Language Performance » English'-Dominant cihildren in MODEL A 

Stanford Achievement Test subtests were used to assess the 
performance of pupils in the second grade. Results of this testing, 
including comparison with the Spring 1970 base line, are shown in Table 6.3. 



TABLE 6.3. PERFORMANCE OP ENGLISH-DOMINANT SECOND-GRADE 



"MODEL A" PUPILS ON THE 


STANFORD 


ACHIEVEMEKT 


PRIMARY BATTERY II 


TtGm 


word 
Meanincr 


Par. 


Sne Hina 


Word-Study 

Skills 


Model A rrogram (N»63) 










Mean Score 


9.7* 


11.9* 


6.8* 


24.7* 


Grade Equivalent 


1.9 


1.7 


2.3 


1.9 


Standard Deviation 


5.6 


7.5 


5.6 


7.5 


Base Line (1970) (N==42) 










Mean Score 


6.0 


8.6 


2.1 


16.5 


Grade Equivalent 


1.7 


1.6 


1.5 


1.4 


Standard Deviation 


3.8 


6.3 


2.1 


6.3 




F 


df 


P 




Multivariate F 


10.8 


4/100 


.001 




Word Meaning 


13.7 


1/103 


.02 




Paragraph Meaning 


5.7 


1/103 


,001 




Spellincj 


27.5 


1/103 


.001 




Word Study Skills 


34.7 


1/103 


.001 





♦Differs from 1970 base line to a statistically significant (p^.02 
or better) degree. 
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SLr^Jr"^"' analysis of variance showed that all of the differences 
SamIL"tIon "™ '""P" at.ti.tio.lS s?;"fI«S! 

n-onth ahead in Paragraph >^.n?^,?'n,it'":oX rhi^dTs^S' Z fiv 
months ahead in Word-Study skills. spelling, and five 

Iowa Testa of Basic Skills 

♦-h« T . fourth-grade English-dominant pupils were tested wi^-h 

s:Jrth-1de^^-- ^^^^^^^ 

clear-cut dL?™*"^^^' • multivariate analysis of variance revealed 
Clear-cut differences in performance between third- and fourth-.Ir«rfr 
pupile on all four measures in the base Hn*. L tourth-grade 

,»i^;i"^";rr: ~ ^^-niifs-^-cS^'fr.. 

duoed aiffe^::oe":"hLe1 ^^ltZl/2T^,^lll dlff 

statistical Significance (p <.J? ^ 1^ ^e^Ld^^alerpupiU^f^^^hT' 

fourth grade, by about or-e oionth of ge score. 

Ihe apparent effect of the program on DUnil n«vf,Nr™- • 
Language usage showed a complex situation' ^e sf^nifiSnt S^ract"on for 



all. 



in Reeding, no clearly significant differences were observed at 



In Vocabulary, the marginal main effect (n^ tk\ 
the ln...r.ction between progra.. !na grade sh":d tl^at*';h«e^«T:n^ 
tendency for fourth-grade pupil, to be slightly behind^. J!! 
While third graders refined essentially thTsLf .'."Ihr^^rilie'grlur 

really .i,S«c\nT™1^TfX-rSr\'reTt::nriSe^'"t 
cluaitn is that there was llttJ^iff! u 1 parsimonious con- 

speaking pupils "se-me tJ^ lTr^t performance of English- 

Sere tested! iMse-line and program groups at the times when they 
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TABLE 6.4. PERFORMANCE OP ENGLISH-DOMINANT 
PUPILS OK IOWA TESTS OP BASIC SKILLS 



Item 



Grade 3 



Progrcm *-fcan GE 
(N»42) SD 
Base-line Mean ge 
(Nw86) SD 
Grade 4 

Program Mean GE 
(N=56 SD 
BasG-line Mean GE 



Vocabulaj 

2.34 
.63 
2.32 
.59 

3.00 
.71 
3.36 



R eadinc 

2.49 
.57 
2.35 
.61 

3.11 

3.23 
1.19 



Language Arithnn>t-{r^ 



Grade 

Multivariate 
Vocal 
Reading 
Language 
Arithmetic 
Program 

Multivariate 

Vocal 

Reading 

Language 

Arithmetic 
Interaction 
' Multivariate 

Vocabulary 

Reading 

Language 
Arithmetic 



F 


df 


£ 


23.4 


4/250 


.001 


55.8 


1/253 


.001 


53„2 


1/253 


.001 


81.9 


1/253 


.001 


62.0 


1/253 


.001 


2.67 


4/250 


.03 


2.23 


1/253 


NS** 


0.001 


1/253 


NS 


0.53 


1/253 


NS 


2.49 


1/253 


NS** 


3.01 


4/250 


.02 


2.32 


4/253 


NS** 


1.47 


1/253 


NS 


8.49 


1/253 


.004 


0.02 


1/153 


1^ 



2.56 
.50 

2.33 
.53 

3.05 
.72 
3.39 
1.03 



2.72 
.72 

2.54 
.69 

3.47 
.80 
3.32 
.94 




*within grade levels, mean scores on respective subtests in i^i- a^a 
^^ot^dxffer from 1968 base lines to a atTtisticairsig^nifLa^t^ 



- 76 - 87 



• 

0d 



c 



CO H 
M CO 



H 
H 

Si 

co^ 



Q 
CO 



m 




1 



CO 

o 



in o 



o 



in 

CM 



00 



m 



H 

CM 



CO 



CM 



00 

in 



rH 



00 



o 



o 

CM 



GO 



o 



CM 



CM 



in 
in 



CO 



in 
in 



o 

00 



CM 



OS 



CD 



vo 



CO 



o 

CM 
CM 



in 



m 



00 
CM 



in 



CM 



•3 



1 



I 



o 
m 



CO 
\0 



0^ 



CO 
VO 



VO 



CM 
H 



in 
• 



m 



o 

H 



CM 



• 



tn 



o 



GO 



0) 
O 
en 



10 



5 



I 

s. 



in 

Q\ O 
H CM 



cn 



CD 



00 



o 

CM 



VO 



O 

< 

CM 



CM 
00 



in 
o 

CM 



CM 



CM 



o 



<M 



CM 



CM 



00 



CM 



0) 

3 



-2 

§ 



8 
I 

o 



ERIC 



- 77 - 



88 



Second-Language Performance 

Table 6.5 shows the perfomance of the third- and fourth-grade 
Spanish dominant pupils in the various components of the program in 
reading English. Program planners stated that beginning with the second 
-jrade, Spanish-dominant pupils in the Model School programs should grow 
one year for each year of English reading instruction. Thus, tliird-grade 
pupils should be reading at about 1.8, fourth-grade pupils should be read- 
ing at about 2.8. As can be seen in the table, performance of MODEL A and 
MODEL B third-grade pupils was at or above the level specified (with the 
exception of MODEL B performance on the Word-Study Skills subtest) . in 
contrast, the MODEL A fourth-grade group did not reach the desired level 
of performance on any test. 

Pupils in the ARRIBA program were also tested to obtain a rough 
estimate of their performance in English. This testing was conducted late 
in June (after the date when school would have ended in a normal year) and 
many were absent, m addition, the ARRIBA program included many students 
who had arrived after the beginning o;.' the school year and thus were not 
eligible to take the test. As a result, the number of pupils taking each 
test was low. 

Second-language test results in ARRIBA were somewhat below those 
of MODEL A and MODEL B. The ARRIBA composite mean score was 1.75 in the 
third grade, and even lower 1.60 in the fourth. The low results were 
anticipated because of the population served by the arriba program at this 
level—pupils newly arrived from Puerto Rico or other Spanish- language areas. 

In order to assess whethe- English second- language performance 
in MCDEL A was dependent upon the length of time pupils were in the program, 
Stanford scores were correlated with the number of years pupils had been 
in the program. Partial correlation was used in which the effect of the 
degree to which Spanish was used in the home and the effect of the pupil's 
havxng been bon or the mainland was partially out. The correlation obtained 
between the number of years and Word Meaning score was .03, for Paragraph 
Meaning .06, for Spelling .04, and for Word-Study Skills .03. None of the 
correlations was statistically significant. 

Fourth-grade MODEL A English-dominant pupils were tested in their 
second language, Spanish. The test used was the Test de Destrezas Basicas 
en Lectura. Performance of this group is shown in Table 6.6" Each subtest 
is listed separately because the degree to which knowledge of Spanish is 
necessary varies markedly for the subtests. Letter and word Recognition do 
not require real knowledge of Spanish because they involve matchir.g of words 
4nd letters and therefore are probably more dependent on visual disci imina- 
tionthan one's knowledge of the language, word and Paragraph Meaning on 
the other hand, require that the children know the lan^uaae.^ The average 
fourth-grade English-dominant pupil was able to read Spanish on these two 
subtests as well as & native Spanish-speaking third-grade child. 
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TABLE 6.6. PEIlPQR>iANCE OP POORTH-GRADE MODEL A ENGLISH-DOMINANT* 

PUPILS IN SPANISH. 



Item 


Word 
Recognition 


Word 
Meaning 


Conprehenaion 


Coraposite 


Moan Score 


62.0 


15.6 


12.4 


91.7 


standard Deviation 


4.4 


5.6 


4.6 


15.8 


Niuaber of Pupils 


59 


58 


57 


56 


Percentile Rank** 


93 


60 


60 


75 



*Nine children in this group were of Spanish background, but were 
treated as Englian-dominant in the program. These children knew more 
Spanish than other English-dominants and received some Spanish instruction 
with Spanish-dominant pupils. **i-w.uv.».ion 

^♦Percentile rank based on rural norms for third- irade native Spanish 

r.h4id.a .K??!S^*! ^^^^ ^f"^^ performance, the English-dominant 

child s ability to read Spanish was unrelated to the lenyth of time he had 
been in the program (r».03). 

Bvaluators' Comment 

Results of this study showed that the program has been very 
successful in teaching reading in the Spanish languages Spanish-dominant 
students were at least at the aoth and often at the 60th percentile in 
their mother tongue, ihese results confirmed the findings of the 1971- 
1972 evaluation, thate Spanish-speaking pupils' mother-tongue performances 
have been enhanced greatly war that which was evident in the base-line 
group. The results also contained a surprise, that the Spanish reading 
performance of Englinh-dominant students was vajci' good, as good as Spanish- 
dominant children one year younger. 

In contrast, results obtained for English performance were not 
clear-cut. Thay showed significant gains for English-dominant second- 
grade children in their mother tongue, but no clear differences for third- 
and fcurth-grade English speakers in the Program and the Base-line groups. 
It is not clear how to interpret the lack of difference, but two aspectT 
unrelated to the program might pert.xn: (a) the lack of gain over the base 
line might reflect the impact of the strikes; (b) ttte lock of gain aight 
reflect the fact that the base line already contair^ some improvement % a 
the performance of English-dominant pupils served by the program du-» to 
tl-e •District 5" reading program mentioned earlier. 

er|c 90 



Thera was little difference in English performance of Spanish- 
dom^.iant children from the third to the fourth grade, while the anti- 
cipated amount of growth from third to fourth grade was not obtained, 
compariaon of the 1973 fourth-grade results with the 1972 third-grade 
results ia instructive. During the one-year period, the average score In- 
creased by four months on the Word Meaning subtest, by two months on the 
Paragraph Meanit^g subtests, and by five mor.ths on the word- 
Stu^ Skills subtest. This suggests that the rate of growth during the 
fourth grade has been heterogeneous and more attention needs to be paid 
to program development in some skill areas than in others. 

A third area which should receive attention is the fourth-grade 
ARRIBA group. There is no apparent reason for these pupils not to be 
reading their mother tongue better than the pupils in the base line. This 
suggests that attention needs to be given to reading instruction at this 
level of the program. 
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STUDY 7 



STANDABDIZED TESTING OF S^K.OING liN THE ''ARRIBA" JUNIOR 
HIGH SCHOOL CIASSES 



In 1971-1972 standardized testing of reading In the Spanish 
language was \andertakan for the first time in the ARRIBA junior high 
■choola. Pupils in seventh and eighth grades of the prograso were com- 
pared with a pre-program base line of scores obtained in a 1968 citywide 
testing of all Philadelphia pupils of Spanish origin (Desing, 1968) , 
Both groups of students ware examined using the Spanish version of the 
Inter-American Test of Reading > L4-CSs . Wiis is the test designated for 
the junior high school by the test maker. 

Results of the 1971-1972 study showed that the mean score in 
the seventh grade had risen from the 9th to the 25th percentile, and in 
the eighth grade from the 8th to the 25th percentile. However, the 1972 
performance of ninth-grade pupils was at the 9th percentile, with a raw 
score slic^tly below that of the eighth graders (there was no ninth-grade 
pre-program base line) . 

In the current evaluation (1972-1973) the testing of ARRIBA 
junior high school students • reading in Spanish has been partially re- 
plicated. Due to strikes during the school year, testing was delayed 
from the end-of-March-beginning-of-April period used in the past to the 
last %roek of May, a delay of about two months. This served as partial 
oowpensation for the instructional time lost during the strikes, but it 
did not compensate for the time needed to review material when school 
resumed after a strike which was nearly as long as a sunmter vacation. 

As a result of these problems, the findings of this study must 
be accepted as tentative. 

In addition to the testing-date change, the 1972-1973 study 
attempted to ferret out the ii^ct of years of English instruction on 
performance in Spanish. This was carried out by using information appear- 
ing on the pupil information forms to obtain the nunfcer of years In 
which program participants were instructed in English between leaving 
their mother country and entering the Bilingual Program. 
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Program 



ARRIBA coiqponent was designed to lerve Sparish-apeaking 
Lf^^^"^ "^"f,^ Philadelphia schools directly from a Spanish 
^J^\Tt ^""^ ' "^^^^ performance in regular English classes sugges- 

ted that they could be helped by instruction conducted in Spanish. At 
the junior high school level, Spanish-.. -a-first-Ianguage courses were 
required for all participants in the program, as wall as other courses 

iL?^?^'"^^^ ^^^^^""^ P«>9ram before 

Dunior high school recexved specific instruction in reading in the 
sparash language, in general, elementary school Spanish reading was 
tau^t using the Laidlaw Reading Series. By the junior high school, these 
texts were often replaced with teacher-selected materials designed to 
meet the more mature interests of the pupils. 



Instrument 



^® Ii^ter-American Test o f Reading (Level 4, Form CEs) was 

^f^^*" ''^^^^''^ ^^^^^ ^^9h school students. 

Vocalnuaxy Level of Comprehension, Speed of Coa^rehension , and Composite 
scores were provided. Norms based on an islandwide san^pling of pupils 
in Puerto Rican «choo?.s were used. 



Subjects 



^ administered to all students in cha seventh, 

eighth and ninth grades who were present in each junior high school on 
the scheduled testing date in the middle of Jtme. Makeups ware given 
*«ien possible, but many students had ceased attending school because of 
the summer heat (testing had intentiorally been delayed as long as 
possible because the teachers' strike had so shortened the academic year) 
One hundred seventeen pupils were tc.-ted. This was 67% of the pupils 
on roll in i^il. ^ 



Method 



Vesting took place in one session. At Penn Treaty, the 
students were gathered in the cafeteria and directions were given by a 
Spanish -spea3a.ng teacher. At Stoddart-Pleisher, the students remained 
in their homerooms and directions were given by a Spanish-speaking 
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weiBber of tha reaearch staff. In both achoola monitoring was done by 
both teachnro and mesnbers of th« rMtaroh staff. 

Base line data froa a study (Desing, 1968) conducted before 
the institution of the Bilingual Program were available for coasparison 
with scores obtained by seventh and eighth graders in 1972-1973. In 
1968, Spanish-speaking students in the Philadelphia schools through 
grade eight took tests which examined Spanish reading ability. The 
Tnter-American Test, Level 4> CEs was taken by seventh and eighth graders 
and the results obtained in that testing were used to determine the pro- 
gress which has been made by students in the Bilingual Program. 



Analysis 

AnzLLysis of variance of raw scores was used to determine whether 
pupil performance in the 7th and 8th grades was s\j|perior to that of the 
pre-program base line group. 

The mean and standard deviation ware con^puted for the ninth- 
grade pupils because there was no pre-program base line for this grade 
level. 

A Pierson product-moment correlation coefficient was also 
coi«?>uted between the raw scores obtained on the test and the nunfcer of 
years in which pupils were involved in English instruction. This analysis 
was confined to the ninth-grade group. 



Results 

Seventh and Eighth Grades 

Overall performance of seventh- and ai^th-grado pupils on 
the Inter-American test is shown in Table 7.1. Pupils in the program 
earned statistically significantly better scores than did students be- 
fore the program. However, pupils did not perform as well as had the 
similar pupils in the equivalent grade levels in 1971-1972. 



Ninth Grade 

The 37 ninth-grade pupils had an average raw score of 39.3, 
and a standard deviation of 13.3, which put the average program paurtiri- 
pant at about the 30th percentile. This was a clear gain over the 
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previous year's results at the 9th percentile. 



TABLE 7.1. PERPOMONCE ON INTBR-AMSRICAN READING 
TEST I>- SPANISH (L4-CEs)* 



Item 



Base line Group 
1968 



ARRIBA Group 
1973 



Grade 7 



Nusfcer of Pupils 
Mean Score 
Standard Deviation 
Percentile of Mean 



97 
19.1 
12.3 
9 



41 
25.3** 
11.2 

21 



Grade 8 



NuBober of P\;^ils 
Mean Score 
Standard Deviation 
Percentile of Mean 



81 
23.2 
14.9 
8 



39 
29.2** 
12.6 

16 



Analysis of Variance 



Source 


Analysis 










Ms 


df 


P 




Triiatinent 


2159.4 


1 


72.6 


.nci 


Gr<&de 


1047.3 


1 


6.1 


.02 


Interaction of Treat & Grade 


0.692 


1 


.0C4 


NS 


within groups 


17?.. 5 


254 







*Spring Semester norms were used (p. 53 of the Test Mamual) . As 
base line data were groiqped in 10-point intervals, the 1973 data were 
similarly grouped, anti analysis was based on the grouptd data. This 
resxilted in slight differences from the means and standixd deviations 
spearing in last year's repos4Mi for which ungrouped data were extracted 
froa the original answer sheets. 

**Diffor8 froa base line to a statistically significant (p-.OOl) 
dsgrae. 
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Relation of Performance to Amount of English Instruction 

An atten^pt was made to determine whether English instruction 
in regular classes breaking the continuity of Spanish instruction was 
detrimental to the Spanish -reading preformance of program participants . 
To this end, a Pierson product-moment correlation coefficient was ob- 
tained between the students ' test scores and the nunber of yaars they 
had received instx^iction ccnducted in English. For all students for whom 
data were availab: a correlation of -.17 (df-29) was obtained, indica- 
ting a very weak and statistically insignificant tendency for pupils 
vith a year or more of instruction English to do more poorly on the 
Tnter-Ainerican test than pupils without the English ittstruction. However, 
it was found that about two-thirds of the pupils had had conUnuous 
Spanish instruction, a fact which probably would keep the correlation 
low, even if there was a relationship. 



Evaluators' comment 

Overall, results continue to show that the scores of seventh- 
and ei^th-grade p^pil8 have ia^rovad from a base line score attributable 
uolely to guessing, to a score ^ich, though below grade-level norms, 
represents an ability to read the test and do some work on it. There 
was a small decline in scores from 1972-1973 for seventh- and eighth- 
grade pxjpils, as e3?pQcted because of the strike. 

In contrast to these small declines, the ninth-grade pupils 
performed better in 1973 than they had the previous year. As 59% of the 
pupils in the ninth-grade gro^p had participated in the program in the 
previous year, this gain may reflect the cumulative effect of program 
participation. 



- 85 - 



STUDY 8 



EB7ECT OF PARTICIPATION IN THE "ARRIBA" PIOGRAM IN TENTH GRADE 
(N CRADUATIQN 9«EVK^CE IN TMBURH GRAGG 

objoctlvi of the ARRIBA oon«>onent wm to reductt 

•aropout Incidence of pupils in its high school lev«i. The Iwt t«o 
f^JiliJJi!"^"^''^^ (Offenborg, 1972, 1973) .howed that the progrem was 
•ffecuve in preventing pupil, from dropping out during the achoci year. 

. percentage of program participant* drop- 

ping out between October and March was con«>uted. The res^xlts of these 
coi««>utationfi were conpared with parallel data for Spanish-speaking 

^.J*^^*^"^ Kensington, Franklin, and Penn hi^ adiools in 

i!^'v^ SSlS ^.^^ beginning of the Bilingual Program. Results 
were very similar xn both years. Por exan^le, in 1971-1972 the dropout 
incidence was reduced from 25.1% to 8.5% in the tenth grade and f roS^ 
Z . ? ^® eleventh grade. Hhe dropout rate shoMod little 
change in the twelfth grade, from a low 6% to 8%. The patt«n inlSese 
results suggested that the program was effective in eliminating most 
tenth- and eleventh grade dropouts during the time when sdiool was in 
session for pupils who were enrolled in ARRIBA program offerings. 

This analysis mi0it be criticized for two reasons. First, 
toopout-xncidence reductions might be maintained only during the period 
i|dien pupils were actually receiving instruction in the ARRiIa co«|onant. 
If this were so, the dropout incidence mi^t rise sharply for pupiU 
during subsequent years if they had no contact with the program/ 

Secondly, dropout reductions mi(^t occur during those parts 
Of the year examined in the previous studies (October to March) only to 

examined. For exai.«>le, many parti- 

^••'^'^ "^^^ ^'^^^ »i9ht withdriT 

during the late spring and svaansr hiatus. 

The real function of confuting dropout rates was to show 
jAether the ARRIBA program has increased the prbbability that a student 
will graduate from school, if it were known that a pupil has graduated, 
it would also be known that he did not leave over vai^on^tSJaJ? or 
Airing the years before graduation ^ich followed his participation in 

Since 1970, a student-by-student record has be. n kept f6r 
program participants. «ii« record permitted the project to answer tt*e 
questicm Of the effect of participation in the ARiSi prograTSSLl^ars 
ago on the actual proportion of pupils who graduated from school in the 
current year. This study addressed itself to answering that question. 
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Program 



The /joiBA cosQonent hl^^ school prograa remained baiically 
unchanged over the three years during which the students examined in 
Zrt ? 2 "J""^ ^ school, course work was offesed in ESL and Spanish 
%joric in Spanish as a first language, selenoe (including bljlogy and 
S!f atudies, and matheaatios {including algiibra, geometry) 

^ZJ^L?^.'^".'**^ ^ ^ •duwlTcouria woikT^^ 

ocmmercial subjects in ^pwiirti was added to the Kensington program. 

spanish-apidnant or very fluent in Spaniehand were 
^lled in the four schools in irtxich the program operSS had ^roption 

^ f^nJ''^'* "^^^^ counselors' advice) one or more courses offS^ 
by the AHRIBA ooiflponent each year. 



Evaluation 



The evaluation w.is designed to answer the question, -Are 
L^no students who partia.pate in the ASRIBA progrwB in the 10th grade 
Bore likely to graduate th. ee years later than are those ^ do not 
participate in the tenth gaade?** 

Subjects 

The subjects of diis study consisted of all students listed 
in tte citywide pupil direc .ory as Spanish-speaking in the tenth grade 
in Deceaber 1970. According* to the Sdiool District's Division of 
Atoinistrative and Survey R( search, if the dominant language in the 
Wil's home was Spanish, the pupil's name should sppear in tha file of 
spanish-speaktas. One hundxtd sixty-four studants appeared in the projects 
!IS ^'^<*-9rade ARRIBA pupils in 1970. One hundred 

^o (62.2%) of these pupils .«peared in the file tibtained from the 

filf; ^-''^5^'^^'^^'^ ^"^^ Research. (It is not clear whether 
scneone decided that the remiining 37.8% of the program participants 
wsre judged by tJie schools tc be from English-dOSdhant homes or were 
missed through poor infoxmati.)n gathering.) 

. '^^ ^ iRpeared in both the project file and the 

Administrative and Survey Researdi file constituted the gro^p of subjects 
in the program group." AU stnidents not listed in the LET'S BE ANCQOS 
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PUpH-infowaation file were trMted as controls . 

possible biasM vers operating in this cowDarison 

^S^^?L?^ ^«duatlng than the experiniental gropp if the program had 

f«??^^.'^H*'^'^J^^"^ ^ counselors into AMRIBA clas^ were g^Sly 
p«i^^ ''^^ difficxaty in performing in regular. 

English-speaking classes. Oie result of this procedure was a bias ii 
favor Of control^iv students in schools where ARRIBA was offered. 
fnSfJSi '^"f^\' i"** on the basis of their ^iS^on 

who could have chosen not to participate in subsequent «ades. tSs 

i^2o2*^r^h 5e^*i^''S'?- "*^'?^^' " <W>ntnt serves high 

l^Tii . ^ •ociosoonoaic status, (Sixty-one percent of the 
friiJ f*^ *^ Franklin, 47% at Keniington, anHst 

^^<*.*° ^•"ili'* of Dependent Children. Sesi iiools 
rank 1. 3. 4, and 7 of the 27 hl^^i schools in the city in terns of tte 
°J™»f"^u'^^ receiving AFDC.) Spanish-donSant ^t- 
side the ARRIBA schools are of hi^ier socioeconomic status. Conteol- 

^'J^V^^^^ ^ -^^iP-t^ 9^^-ti'on 

While there was no clean way of eliminating any of tha thre« 
J^ema, making two different sets of con«^.ons woutfc^^ tJ^"""* 
in«>act of each of the pzobleae. in the first set of conp^lSsrpro- 

Sr.?^f ""^"^ Spanish-dominant students from ill over 

the city. «vx8 reduced the Ixioact of the first and second biases above 
at the expense of adding tho third. Ccaparison of program studJStfS^ 
Spanish-dominant students at only their own school elSinated S^lhl^d 
bias but increased the iiqpact of the first and second. To provide as 
fair a representaaon of program outcome as possible, both oontrol- 
group coBflparisons were made. In coapiling the data for this study, the 
102 students in the ARRIBA program were coii«»ared with the 326 Spanish- 
fLSfS^^"^/" directory but not in the ARRIBA ?JS^am, 

on citywide basis, and also with the 196 Spanish pupils not pLtS?^ 
^^e ^^L^"""" """^ enrolled in tenth grade in sdiools served 
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Ifethod 



Tho current puc>ll directory was used to locate any pupils 
who had changed schools due to moving. Graduation lists were then 
chedied to determine whether each studen-. had graduated In the Spring 
of 1973. 



Analysis 

Percentage of pupils graduating was computed for each group, 
and cSxi-squares were computed to detenaine the statistical significance 
of the differences observed. 



Reaulta 

Table 8.1 ooiqpares tenth-grade program pupils with Spanish- 
dominant pupUs cltywlde. Ihls Is the analysis in which the control- 
group was biased by hi^ socioecoaomic status . As can be seen in the 
table, despite the possibility of this bias, there were strong, stat- 
tistlcally significant differences in favor of the prograa, with 
participants 1.8 times as likely to graduate as the ba«e line group. 



TABI£ 8.1 GRADQATION MOBS OF SPANZSH-DOMHIAMT PUPILS 
GRACE 10 m DECEMBER 1970 



Group 


Graduated 


Not Graduated 


Total 


M % 


N % 


K . % 


In ARRIBA 

Hot in ARRIBA (Cltywlde) 


38 (37.3) 
68 (20.9) 


64 (62.7) 
258 (79.1) 


102 (100) 
326 (100) 


Chi-square • 10.3, df 3 1, p<.005 
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Coaparlson of atud«nts in the pxcgrwa with othora in their 
oun «du3olt i« shown in Table 8.2. This cooqparison was probably biaaed 

2L?2 I^^i'^i^f^^i.^'/^L^? program: pupil, whoae counselors thought 
wuld hava difficulty in English clasaes were more likely to be en- 
rolled in this program than pupils who were doing well in school. As 
can be seen in this table, tiie statistically significant results were 
f^"*^^? ^ cccyparisons: program students were 

^S^L^if^r ^ ^f"*^^ ^ *• ^•'^ Spanish^minant 

atuoents in the same school. 

Prom these figures it was easy to calculate the graduation 
rate of pupils in schools other than those served by the program— 
scaiools with a much higher socioeconomic status and schools offering 
special vocaUc^nal and technical programs. The result was 57%. 

lABLE 8.2. GPADUKPION SATES OP SPANISH-DOMINMJT PUPILS 
IN GRADE 10 IN OEGBMBE^ 1970 



I .1. 




In ARRIBA 

Met in ARRIBA (Same School) 



Graduated 



38 (37.3) 
21 (10.7) 



Wot Graduated 



64 

175 



(62.7) 
(89.3) 



102 (100) 
196 (100) 



Chi -square - 57.-;, df « 1, p^OOl 



Evaluators' Conment 

^«w.ii.^ confirm previous evidence that pupili 

enrolled xn the Bilingual Program are coac)leting school at a hirfier 
rate than are similar students in regular classes. 

The large discrepancy between the rates for ARRIBA and non- 
ARRIBA pui^ila at the four hi0i schools served is especially deserving 
of attention. Given the selection procedure used (counselors* recom- 
mendations) to enroll students in ARRIBA and the bias resulting in 
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favor of nonpzograxB otudenta, discrepancy was Initially a suzprise 
Hojievjr. oonsidaration of a finding in last year's evaluation may 
•jplain this outcooie. in a fbllow-np or. pupils tnrolled in regular 
Sllir 1973) it appeared that there might be a discrepancy 

ba1a»aen tha amount of English needed for a counoelor to recommend that 
a pupil be enrolled in a regular English-language classroom and the 
amount of English needed to succeed in that classroom. The large dis- 
crepancy batween dropout rates of ahriba students and of other Spanish- 
<^nant students in the same schools might be attributed to a similar 
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